Jul 18 00:40:21.349815 ip-10-0-136-82 systemd[1]: Starting Kubernetes Kubelet... Jul 18 00:40:21.729587 ip-10-0-136-82 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:21.729587 ip-10-0-136-82 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 00:40:21.729587 ip-10-0-136-82 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:21.729587 ip-10-0-136-82 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 00:40:21.729587 ip-10-0-136-82 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:21.730275 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.729844 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 00:40:21.733722 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733702 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.733722 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733721 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.733722 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733724 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733728 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733731 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733734 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733736 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733739 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733741 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733744 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733746 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733749 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733751 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733754 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733757 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733760 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733763 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733768 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733771 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733774 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733778 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733781 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.733814 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733784 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733786 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733789 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733792 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733794 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733797 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733799 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733802 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733804 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733807 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733809 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733812 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733815 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733818 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733821 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733825 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733827 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733830 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733833 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733836 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.734319 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733838 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733841 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733843 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733846 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733848 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733851 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733854 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733856 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733859 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733861 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733865 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733868 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733872 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733874 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733877 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733879 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733882 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733884 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733886 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.734810 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733888 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733891 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733893 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733897 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733899 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733901 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733904 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733907 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733910 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733912 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733915 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733917 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733920 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733922 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733925 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733927 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733930 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733932 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733934 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733937 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.735250 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733940 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733942 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733945 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733948 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733951 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733954 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733956 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733959 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733961 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733964 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733966 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733968 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733971 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733973 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733975 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733978 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733981 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.733983 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734697 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.735737 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734703 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734706 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734709 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734711 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734714 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734716 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734719 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734722 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734724 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734727 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734729 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734734 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734737 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734741 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734744 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734747 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734749 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734752 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734755 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.736189 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734760 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734762 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734765 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734768 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734772 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734775 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734777 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734780 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734782 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734785 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734787 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734790 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734793 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734795 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734798 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734801 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734803 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734806 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734808 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734810 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.736704 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734814 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734816 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734819 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734822 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734824 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734827 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734829 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734832 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734834 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734836 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734839 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734841 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734843 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734846 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734849 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734851 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734853 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734856 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734858 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734861 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.737194 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734863 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734866 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734869 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734871 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734875 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734877 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734880 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734882 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734884 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734887 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734889 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734891 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734894 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734896 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734898 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734901 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734904 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734906 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734908 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.737682 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734911 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734913 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734916 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734918 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734921 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734923 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734925 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734927 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734930 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734932 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734935 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734937 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734939 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734941 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734944 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734947 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734951 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734954 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734957 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.738140 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.734960 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735403 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735409 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735411 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735414 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735417 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735420 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735422 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735425 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735429 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735432 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735435 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735438 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735441 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735444 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735447 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735450 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735452 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735454 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.738621 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735457 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735459 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735462 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735465 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735467 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735470 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735472 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735475 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735478 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735498 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735502 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735505 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735509 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735512 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735514 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735517 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735520 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735522 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735525 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.739081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735528 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735530 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735532 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735535 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735538 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735540 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735543 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735545 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735547 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735550 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735552 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735555 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735557 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735559 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735561 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735564 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735566 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735574 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735576 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.739581 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735578 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735581 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735583 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735586 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735588 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735591 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735593 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735596 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735598 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735602 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735606 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735609 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735611 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735614 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735617 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735619 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735622 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735624 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735627 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735630 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.740023 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735632 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735634 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735637 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735640 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735643 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735645 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735647 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735650 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735652 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735656 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735660 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735662 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735665 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735667 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735669 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735672 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735674 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735677 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735679 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735681 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.740513 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735684 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735686 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.735689 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735761 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735774 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735781 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735785 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735788 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735791 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735795 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735800 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735803 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735805 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735809 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735812 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735814 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735818 2577 flags.go:64] FLAG: --cgroup-root="" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735821 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735824 2577 flags.go:64] FLAG: --client-ca-file="" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735827 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735829 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735833 2577 flags.go:64] FLAG: --cluster-domain="" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735837 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735840 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 00:40:21.741102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735842 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735845 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735849 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735852 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735855 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735858 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735861 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735863 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735866 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735869 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735872 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735876 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735878 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735881 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735884 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735886 2577 flags.go:64] FLAG: --enable-server="true" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735889 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735894 2577 flags.go:64] FLAG: --event-burst="100" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735897 2577 flags.go:64] FLAG: --event-qps="50" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735900 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735902 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735905 2577 flags.go:64] FLAG: --eviction-hard="" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735909 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735914 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735930 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 00:40:21.741688 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735936 2577 flags.go:64] FLAG: --eviction-soft="" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735941 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735945 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735949 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735954 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735957 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735960 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735962 2577 flags.go:64] FLAG: --feature-gates="" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735966 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735969 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735972 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735976 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735978 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735981 2577 flags.go:64] FLAG: --help="false" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735984 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-136-82.ec2.internal" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735987 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735990 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735992 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735996 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.735999 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736002 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736004 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736007 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 00:40:21.742318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736009 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736012 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736015 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736018 2577 flags.go:64] FLAG: --kube-reserved="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736021 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736023 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736026 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736029 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736031 2577 flags.go:64] FLAG: --lock-file="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736034 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736037 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736040 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736045 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736048 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736051 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736054 2577 flags.go:64] FLAG: --logging-format="text" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736056 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736059 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736062 2577 flags.go:64] FLAG: --manifest-url="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736064 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736068 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736071 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736075 2577 flags.go:64] FLAG: --max-pods="110" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736078 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736081 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 00:40:21.742898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736084 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736086 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736089 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736092 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736094 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736102 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736104 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736107 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736110 2577 flags.go:64] FLAG: --pod-cidr="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736112 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736119 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736121 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736124 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736127 2577 flags.go:64] FLAG: --port="10250" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736130 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736132 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dc95678b7bdbbb1f" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736135 2577 flags.go:64] FLAG: --qos-reserved="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736138 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736141 2577 flags.go:64] FLAG: --register-node="true" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736144 2577 flags.go:64] FLAG: --register-with-taints="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736148 2577 flags.go:64] FLAG: --registry-burst="10" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736150 2577 flags.go:64] FLAG: --registry-qps="5" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736153 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736156 2577 flags.go:64] FLAG: --reserved-memory="" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736159 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 00:40:21.743539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736162 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736165 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736167 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736170 2577 flags.go:64] FLAG: --runonce="false" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736172 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736176 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736178 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736181 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736184 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736186 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736189 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736192 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736195 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736198 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736201 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736204 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736207 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736209 2577 flags.go:64] FLAG: --system-cgroups="" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736212 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736217 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736220 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736222 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736226 2577 flags.go:64] FLAG: --tls-min-version="" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736229 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736232 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 00:40:21.744133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736237 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736242 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736245 2577 flags.go:64] FLAG: --v="2" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736249 2577 flags.go:64] FLAG: --version="false" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736253 2577 flags.go:64] FLAG: --vmodule="" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736257 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.736260 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736374 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736379 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736383 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736386 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736389 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736392 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736394 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736397 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736399 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736402 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736404 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736407 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736409 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.744763 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736412 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736414 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736416 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736419 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736421 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736423 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736426 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736428 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736430 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736433 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736435 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736438 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736441 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736445 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736448 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736450 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736453 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736455 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736458 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736460 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.745248 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736462 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736465 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736467 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736469 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736472 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736474 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736476 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736495 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736498 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736500 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736503 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736513 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736516 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736519 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736521 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736523 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736526 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736528 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736531 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736534 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736536 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.745790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736538 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736541 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736543 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736547 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736551 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736555 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736559 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736561 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736563 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736566 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736568 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736571 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736573 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736575 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736578 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736580 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736582 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736585 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736589 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736592 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.746286 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736594 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736597 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736600 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736603 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736606 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736608 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736611 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736614 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736616 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736619 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736622 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736625 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736628 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736631 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736635 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736639 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736644 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736647 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736649 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.746779 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736653 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736656 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736658 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736660 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736663 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.736665 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.737626 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.745305 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.745325 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.745345 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.745351 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745418 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745425 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745428 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.747245 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745432 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745435 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745438 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745441 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745443 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745446 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745449 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745451 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745453 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745456 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745459 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745461 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745464 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745466 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745468 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745472 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745476 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745479 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745505 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.747681 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745508 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745511 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745513 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745516 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745518 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745521 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745523 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745527 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745529 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745532 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745534 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745537 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745539 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745543 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745545 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745548 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745551 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745553 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745556 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745558 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.748120 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745561 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745563 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745565 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745568 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745570 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745572 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745575 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745577 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745580 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745583 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745586 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745588 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745597 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745600 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745602 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745605 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745607 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745610 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745612 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745616 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.748620 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745618 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745621 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745623 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745625 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745628 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745630 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745632 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745635 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745637 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745639 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745642 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745644 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745646 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745649 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745651 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745653 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745656 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745658 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745661 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745663 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.749102 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745665 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745668 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745670 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745674 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745677 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745686 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745689 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745691 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745694 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745696 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745699 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745702 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745708 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745710 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745713 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745715 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.749640 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745719 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.745724 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745875 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745881 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745883 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745886 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745888 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745891 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745893 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745895 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745898 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745900 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745903 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745905 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745908 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:21.750054 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745910 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745912 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745915 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745917 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745920 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745922 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745924 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745934 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745938 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745941 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745943 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745946 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745949 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745952 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745955 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745958 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745960 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745962 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745965 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:21.750424 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745967 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745971 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745974 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745977 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745979 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745982 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745987 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745989 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745992 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745994 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745996 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.745999 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746001 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746003 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746006 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746008 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746010 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746013 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:21.750893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746015 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746018 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746031 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746034 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746036 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746039 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746041 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746044 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746046 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746049 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746051 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746054 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746056 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746058 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746060 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746063 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746065 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746068 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746071 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746073 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:21.751340 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746075 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746078 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746080 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746082 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746085 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746087 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746090 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746092 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746094 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746097 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746099 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746101 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746105 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746108 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746111 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746118 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746121 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746123 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746126 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:21.751917 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746129 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746131 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746134 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746137 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746139 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746142 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746144 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746146 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:21.746149 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.746154 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.746308 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.748584 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.749869 2577 server.go:1019] "Starting client certificate rotation" Jul 18 00:40:21.752423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.749968 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:40:21.752771 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.750583 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:40:21.752771 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.752500 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:40:21.758847 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.758822 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:40:21.768670 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.768650 2577 log.go:25] "Validated CRI v1 runtime API" Jul 18 00:40:21.770671 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.770655 2577 log.go:25] "Validated CRI v1 image API" Jul 18 00:40:21.772303 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.772277 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 00:40:21.778585 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.778561 2577 fs.go:135] Filesystem UUIDs: map[1be99b2d-e760-49ae-8999-c29f2c8f0a29:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b3b382bd-3e22-4b7a-bd78-9b3cebedf1e2:/dev/nvme0n1p4] Jul 18 00:40:21.778585 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.778582 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 00:40:21.780802 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.780778 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:40:21.784295 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.784168 2577 manager.go:216] Machine: {Timestamp:2026-07-18 00:40:21.782731757 +0000 UTC m=+0.317614734 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3209139 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2435758bf587d9b0974fc0ad229032 SystemUUID:ec243575-8bf5-87d9-b097-4fc0ad229032 BootID:31d666e7-10e5-4f63-9b03-cfbdb8aaf07c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:d5:71:99:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:d5:71:99:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:2b:9b:9a:9f:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 00:40:21.784295 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.784291 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 00:40:21.784405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.784385 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 00:40:21.787706 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.787677 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 00:40:21.787856 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.787708 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 00:40:21.788925 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.788914 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 00:40:21.788967 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.788928 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 00:40:21.788967 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.788935 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:40:21.788967 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.788950 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:40:21.790181 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.790169 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 00:40:21.792818 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.792803 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:40:21.792969 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.792960 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 00:40:21.793003 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.792990 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 18 00:40:21.793003 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793000 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 00:40:21.793052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793018 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 00:40:21.793052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793028 2577 kubelet.go:398] "Adding apiserver pod source" Jul 18 00:40:21.793052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793042 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 00:40:21.793543 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793527 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:40:21.793617 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.793554 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:40:21.797024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.796999 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 00:40:21.799056 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.799042 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 00:40:21.799100 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.799073 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 00:40:21.800147 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800127 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 00:40:21.800147 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800146 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800152 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800158 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800166 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800172 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800179 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800184 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800194 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800199 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800208 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 00:40:21.800223 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800213 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 00:40:21.801010 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.800998 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 00:40:21.801010 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.801009 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 00:40:21.804802 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.804774 2577 server.go:1268] "Started kubelet" Jul 18 00:40:21.808942 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.808899 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 00:40:21.809295 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.809271 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 00:40:21.809394 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.809344 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 00:40:21.809659 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.809624 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 00:40:21.809977 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.809702 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 00:40:21.810059 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.810013 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 00:40:21.811032 ip-10-0-136-82 systemd[1]: Started Kubernetes Kubelet. Jul 18 00:40:21.811962 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.811825 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 00:40:21.812550 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.812524 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 18 00:40:21.813976 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.813949 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 00:40:21.815572 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.814632 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-82.ec2.internal.18c33b6e2fe27334 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-82.ec2.internal,UID:ip-10-0-136-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-82.ec2.internal,},FirstTimestamp:2026-07-18 00:40:21.804659508 +0000 UTC m=+0.339542485,LastTimestamp:2026-07-18 00:40:21.804659508 +0000 UTC m=+0.339542485,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-82.ec2.internal,}" Jul 18 00:40:21.817577 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.817556 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 00:40:21.817577 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.817564 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 00:40:21.817726 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.817624 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:21.818170 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818148 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 00:40:21.818170 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818165 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 00:40:21.818298 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818171 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 00:40:21.818354 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818307 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 18 00:40:21.818354 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818315 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 18 00:40:21.818628 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818612 2577 factory.go:55] Registering systemd factory Jul 18 00:40:21.818687 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818633 2577 factory.go:223] Registration of the systemd container factory successfully Jul 18 00:40:21.818858 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818838 2577 factory.go:153] Registering CRI-O factory Jul 18 00:40:21.818858 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818857 2577 factory.go:223] Registration of the crio container factory successfully Jul 18 00:40:21.818991 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818897 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 00:40:21.818991 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818918 2577 factory.go:103] Registering Raw factory Jul 18 00:40:21.818991 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.818931 2577 manager.go:1196] Started watching for new ooms in manager Jul 18 00:40:21.819284 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.819272 2577 manager.go:349] Starting recovery of all containers Jul 18 00:40:21.820670 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.820622 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 18 00:40:21.820670 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.820644 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 18 00:40:21.824393 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.824366 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9fhrb" Jul 18 00:40:21.827890 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.827687 2577 manager.go:354] Recovery completed Jul 18 00:40:21.831507 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.831474 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9fhrb" Jul 18 00:40:21.832709 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.832696 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:21.834915 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.834899 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:21.834980 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.834930 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:21.834980 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.834942 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:21.835550 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.835536 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 00:40:21.835550 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.835549 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 00:40:21.835660 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.835551 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:21.835660 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.835569 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:40:21.836545 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836476 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:21.836587 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836568 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:21.836587 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836579 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:21.836655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836648 2577 policy_none.go:49] "None policy: Start" Jul 18 00:40:21.836682 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836662 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 00:40:21.836682 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.836672 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 00:40:21.836787 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.836724 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-82.ec2.internal.18c33b6e31b01f3c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-82.ec2.internal,UID:ip-10-0-136-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-82.ec2.internal,},FirstTimestamp:2026-07-18 00:40:21.834915644 +0000 UTC m=+0.369798620,LastTimestamp:2026-07-18 00:40:21.834915644 +0000 UTC m=+0.369798620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-82.ec2.internal,}" Jul 18 00:40:21.837686 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.837674 2577 policy_none.go:47] "Start" Jul 18 00:40:21.871172 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871149 2577 manager.go:337] "Starting Device Plugin manager" Jul 18 00:40:21.871306 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.871189 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 00:40:21.871306 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871200 2577 server.go:87] "Starting device plugin registration server" Jul 18 00:40:21.871471 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871459 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 00:40:21.871544 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871471 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 00:40:21.871600 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871583 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 00:40:21.871677 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871666 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 00:40:21.871677 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.871677 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 00:40:21.872246 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.872216 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 00:40:21.872344 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.872268 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:21.957168 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.957132 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 00:40:21.958542 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.958521 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 00:40:21.958683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.958561 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 00:40:21.958683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.958588 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 00:40:21.958683 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.958631 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 00:40:21.960626 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.960608 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:21.971625 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.971605 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:21.973384 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.973366 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:21.973479 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.973397 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:21.973479 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.973409 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:21.973479 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.973433 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-82.ec2.internal" Jul 18 00:40:21.981793 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:21.981740 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-82.ec2.internal" Jul 18 00:40:21.981793 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:21.981770 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-82.ec2.internal\": node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.002874 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.002852 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.058721 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.058681 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal"] Jul 18 00:40:22.058853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.058767 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:22.060337 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.060317 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:22.060436 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.060348 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:22.060436 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.060359 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:22.061676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.061663 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:22.061776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.061757 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.061823 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.061804 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:22.062571 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062552 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:22.062669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062553 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:22.062669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062614 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:22.062669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062630 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:22.062669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062584 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:22.062669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.062652 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:22.063846 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.063832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.063896 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.063865 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:22.064665 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.064650 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:22.064739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.064675 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:22.064739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.064688 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:22.089381 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.089351 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-82.ec2.internal\" not found" node="ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.093951 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.093929 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-82.ec2.internal\" not found" node="ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.103543 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.103521 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.204670 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.204622 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.219953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.219927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.220060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.219966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2b1c5a1c951ba2dea802fc68a7b0c0f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-82.ec2.internal\" (UID: \"e2b1c5a1c951ba2dea802fc68a7b0c0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.220060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.219987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.305377 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.305350 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.320718 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320690 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.320803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.320803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2b1c5a1c951ba2dea802fc68a7b0c0f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-82.ec2.internal\" (UID: \"e2b1c5a1c951ba2dea802fc68a7b0c0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.320803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320782 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2b1c5a1c951ba2dea802fc68a7b0c0f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-82.ec2.internal\" (UID: \"e2b1c5a1c951ba2dea802fc68a7b0c0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.320925 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320810 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.320925 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.320812 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/190049d7968bdc78972d2e10f65e43fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal\" (UID: \"190049d7968bdc78972d2e10f65e43fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.392908 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.392867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.397433 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.396503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:22.406013 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.405989 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.506617 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.506578 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.609209 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.609173 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.710315 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.710268 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.749284 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.749246 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 00:40:22.749955 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.749416 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:40:22.810421 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.810382 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.835160 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.835074 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:35:22 +0000 UTC" deadline="2028-04-04 03:05:51.70566724 +0000 UTC" Jul 18 00:40:22.835160 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.835107 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15026h25m28.870563543s" Jul 18 00:40:22.910850 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:22.910806 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-82.ec2.internal\" not found" Jul 18 00:40:22.919054 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:22.919026 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:22.995501 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:22.995467 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b1c5a1c951ba2dea802fc68a7b0c0f.slice/crio-4e3ba67fd01e2c4e914ceabdfd495de09d678746ed8269eeb8c717e886a56640 WatchSource:0}: Error finding container 4e3ba67fd01e2c4e914ceabdfd495de09d678746ed8269eeb8c717e886a56640: Status 404 returned error can't find the container with id 4e3ba67fd01e2c4e914ceabdfd495de09d678746ed8269eeb8c717e886a56640 Jul 18 00:40:22.996010 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:22.995987 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190049d7968bdc78972d2e10f65e43fd.slice/crio-bcc1c9e3ce86b65d3bfa32e0fbe221253f7d025a45364829af7e73385d18d493 WatchSource:0}: Error finding container bcc1c9e3ce86b65d3bfa32e0fbe221253f7d025a45364829af7e73385d18d493: Status 404 returned error can't find the container with id bcc1c9e3ce86b65d3bfa32e0fbe221253f7d025a45364829af7e73385d18d493 Jul 18 00:40:23.003532 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.003511 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:40:23.018502 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.018456 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" Jul 18 00:40:23.032470 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.032446 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:40:23.034780 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.034764 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" Jul 18 00:40:23.043636 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.043607 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:40:23.059270 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.059246 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:23.091428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.091333 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:23.794602 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.794560 2577 apiserver.go:52] "Watching apiserver" Jul 18 00:40:23.803394 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.803361 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 00:40:23.805631 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.805596 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal","openshift-multus/multus-additional-cni-plugins-h9gbq","openshift-multus/multus-sm766","openshift-multus/network-metrics-daemon-ggk8j","kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr","openshift-cluster-node-tuning-operator/tuned-ghrt2","openshift-network-diagnostics/network-check-target-hw6bp","openshift-network-operator/iptables-alerter-k4h22","openshift-ovn-kubernetes/ovnkube-node-9v62v","kube-system/global-pull-secret-syncer-kwvtd","kube-system/konnectivity-agent-tcwbt","openshift-dns/node-resolver-znnm9","openshift-image-registry/node-ca-slv4q"] Jul 18 00:40:23.807675 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.807649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.809800 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.809755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.810660 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.810635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 00:40:23.810993 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.810972 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 00:40:23.811352 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.811334 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b48gg\"" Jul 18 00:40:23.811655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.811632 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.811749 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.811663 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.811749 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.811638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 00:40:23.812065 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.811673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm766" Jul 18 00:40:23.813397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.812730 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 00:40:23.813397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.812867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.813397 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:23.812948 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.813985 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814200 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brvm5\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814439 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s2rdz\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814787 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814792 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814903 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.814916 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.815269 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.815004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.816566 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.816036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.817257 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.817235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cfrqw\"" Jul 18 00:40:23.817373 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.817356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 00:40:23.817731 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.817550 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.817989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.818255 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.818438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.818709 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.819117 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.819174 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x6gwb\"" Jul 18 00:40:23.819744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.819538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.820652 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.820628 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 00:40:23.821526 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.821501 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.822013 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.821985 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.822093 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.822020 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x2zbl\"" Jul 18 00:40:23.824837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.823126 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.824837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.823226 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.824837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.824695 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w9cl5\"" Jul 18 00:40:23.826505 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.826140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:23.826505 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:23.826251 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:23.827994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.827972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-systemd\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-lib-modules\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-tmp\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-kubelet\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-kubelet\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-slash\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw6pk\" (UniqueName: \"kubernetes.io/projected/f2418eab-d788-463b-8352-81f7f20a850c-kube-api-access-mw6pk\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-netns\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-host\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.829984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-multus-certs\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-etc-kubernetes\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.830427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-system-cni-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-kubernetes\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-bin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-systemd-units\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-systemd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-log-socket\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovn-node-metrics-cert\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-bin\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-netd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cnibin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-socket-dir-parent\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-tuned\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-cnibin\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.831776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830455 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-os-release\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2418eab-d788-463b-8352-81f7f20a850c-iptables-alerter-script\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830527 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cni-binary-copy\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-tmp-dir\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-daemon-config\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqbk\" (UniqueName: \"kubernetes.io/projected/da4847b6-4537-4d72-a655-01dbb0e7646a-kube-api-access-qbqbk\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45z2\" (UniqueName: \"kubernetes.io/projected/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-kube-api-access-b45z2\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r99j\" (UniqueName: \"kubernetes.io/projected/8a98e723-b54e-4254-8261-a3fffacdd887-kube-api-access-8r99j\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830776 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2418eab-d788-463b-8352-81f7f20a850c-host-slash\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysconfig\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqhtw\" (UniqueName: \"kubernetes.io/projected/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-kube-api-access-wqhtw\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-etc-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830946 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 00:40:23.832396 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.830978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6q29\"" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-sys\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831072 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-multus\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-hosts-file\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-netns\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-var-lib-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-modprobe-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-run\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831269 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-config\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-ovn\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll46h\" (UniqueName: \"kubernetes.io/projected/676041f7-b064-4cda-9ba6-7c78b5fe9202-kube-api-access-ll46h\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-os-release\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:23.831436 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-k8s-cni-cncf-io\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-hostroot\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-node-log\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-var-lib-kubelet\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-conf-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjb9n\" (UniqueName: \"kubernetes.io/projected/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-kube-api-access-kjb9n\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831658 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-env-overrides\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-script-lib\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-conf\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwfv\" (UniqueName: \"kubernetes.io/projected/168265b4-47f2-4929-8cec-d37d893dc4bc-kube-api-access-ddwfv\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.831801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-system-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.833753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.832781 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:23.834464 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.834294 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:40:23.835097 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.835077 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 00:40:23.835663 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.835635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bdjh\"" Jul 18 00:40:23.835887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.835870 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 00:40:23.836044 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.836031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 00:40:23.859138 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.859100 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6rv4" Jul 18 00:40:23.866521 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.866143 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k6rv4" Jul 18 00:40:23.919466 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.919437 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 00:40:23.932668 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-conf\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwfv\" (UniqueName: \"kubernetes.io/projected/168265b4-47f2-4929-8cec-d37d893dc4bc-kube-api-access-ddwfv\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-system-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6745688-c862-4ba3-bbd2-6a5cb0335dde-agent-certs\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-systemd\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-lib-modules\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.932857 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-tmp\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-kubelet\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-kubelet-config\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-kubelet\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-slash\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.932985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw6pk\" (UniqueName: \"kubernetes.io/projected/f2418eab-d788-463b-8352-81f7f20a850c-kube-api-access-mw6pk\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933100 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-slash\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-kubelet\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-systemd\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-netns\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-netns\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-host\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933351 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-host\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-multus-certs\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933394 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-lib-modules\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-etc-kubernetes\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-dbus\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933468 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-system-cni-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.933491 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-system-cni-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysctl-conf\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-multus-certs\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-kubernetes\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-etc-kubernetes\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-bin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123ca7fe-59f2-4012-88f1-a755b47e1ffb-host\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933717 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-system-cni-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-systemd-units\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933748 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-kubernetes\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-bin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-systemd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-log-socket\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovn-node-metrics-cert\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933826 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-systemd-units\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-systemd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.934210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933645 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-kubelet\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-bin\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-bin\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-netd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cnibin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933932 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-cni-netd\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-socket-dir-parent\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.933985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-tuned\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934021 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-cnibin\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934084 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-os-release\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2418eab-d788-463b-8352-81f7f20a850c-iptables-alerter-script\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cni-binary-copy\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934188 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934244 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-tmp-dir\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934259 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-cnibin\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-daemon-config\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934326 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-os-release\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-log-socket\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-socket-dir-parent\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-run-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934462 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934794 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f2418eab-d788-463b-8352-81f7f20a850c-iptables-alerter-script\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-tmp-dir\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934868 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cnibin\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.935917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmbx\" (UniqueName: \"kubernetes.io/projected/123ca7fe-59f2-4012-88f1-a755b47e1ffb-kube-api-access-jtmbx\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934907 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-daemon-config\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqbk\" (UniqueName: \"kubernetes.io/projected/da4847b6-4537-4d72-a655-01dbb0e7646a-kube-api-access-qbqbk\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45z2\" (UniqueName: \"kubernetes.io/projected/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-kube-api-access-b45z2\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.934986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r99j\" (UniqueName: \"kubernetes.io/projected/8a98e723-b54e-4254-8261-a3fffacdd887-kube-api-access-8r99j\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-cni-binary-copy\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2418eab-d788-463b-8352-81f7f20a850c-host-slash\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysconfig\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqhtw\" (UniqueName: \"kubernetes.io/projected/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-kube-api-access-wqhtw\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-etc-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2418eab-d788-463b-8352-81f7f20a850c-host-slash\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-sys\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-multus\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-sysconfig\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.936841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-hosts-file\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935267 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-sys\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-netns\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6745688-c862-4ba3-bbd2-6a5cb0335dde-konnectivity-ca\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-var-lib-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935369 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a98e723-b54e-4254-8261-a3fffacdd887-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-modprobe-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-run\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-hosts-file\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123ca7fe-59f2-4012-88f1-a755b47e1ffb-serviceca\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935463 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-modprobe-d\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-run\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935529 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-etc-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935527 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a98e723-b54e-4254-8261-a3fffacdd887-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-var-lib-cni-multus\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-netns\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.937517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-var-lib-openvswitch\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-config\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935751 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-ovn\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll46h\" (UniqueName: \"kubernetes.io/projected/676041f7-b064-4cda-9ba6-7c78b5fe9202-kube-api-access-ll46h\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-os-release\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-k8s-cni-cncf-io\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-hostroot\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935883 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-node-log\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-var-lib-kubelet\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-conf-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjb9n\" (UniqueName: \"kubernetes.io/projected/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-kube-api-access-kjb9n\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.935988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-env-overrides\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.938410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-script-lib\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936294 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-config\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936369 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-run-ovn\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936653 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovnkube-script-lib\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/676041f7-b064-4cda-9ba6-7c78b5fe9202-node-log\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:23.936764 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936776 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/168265b4-47f2-4929-8cec-d37d893dc4bc-var-lib-kubelet\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-multus-conf-dir\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936798 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-os-release\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936871 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4847b6-4537-4d72-a655-01dbb0e7646a-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:23.936892 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:24.436854172 +0000 UTC m=+2.971737170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936893 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-host-run-k8s-cni-cncf-io\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.936908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-hostroot\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.937260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/676041f7-b064-4cda-9ba6-7c78b5fe9202-env-overrides\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.939263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.938554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-etc-tuned\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.942595 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.942570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/168265b4-47f2-4929-8cec-d37d893dc4bc-tmp\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.944780 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.944754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/676041f7-b064-4cda-9ba6-7c78b5fe9202-ovn-node-metrics-cert\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.951945 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.951909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwfv\" (UniqueName: \"kubernetes.io/projected/168265b4-47f2-4929-8cec-d37d893dc4bc-kube-api-access-ddwfv\") pod \"tuned-ghrt2\" (UID: \"168265b4-47f2-4929-8cec-d37d893dc4bc\") " pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:23.952288 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.952258 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw6pk\" (UniqueName: \"kubernetes.io/projected/f2418eab-d788-463b-8352-81f7f20a850c-kube-api-access-mw6pk\") pod \"iptables-alerter-k4h22\" (UID: \"f2418eab-d788-463b-8352-81f7f20a850c\") " pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:23.956647 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.956612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll46h\" (UniqueName: \"kubernetes.io/projected/676041f7-b064-4cda-9ba6-7c78b5fe9202-kube-api-access-ll46h\") pod \"ovnkube-node-9v62v\" (UID: \"676041f7-b064-4cda-9ba6-7c78b5fe9202\") " pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:23.957044 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.957023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45z2\" (UniqueName: \"kubernetes.io/projected/d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5-kube-api-access-b45z2\") pod \"node-resolver-znnm9\" (UID: \"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5\") " pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:23.957175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.957154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r99j\" (UniqueName: \"kubernetes.io/projected/8a98e723-b54e-4254-8261-a3fffacdd887-kube-api-access-8r99j\") pod \"multus-additional-cni-plugins-h9gbq\" (UID: \"8a98e723-b54e-4254-8261-a3fffacdd887\") " pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:23.957222 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.957187 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqbk\" (UniqueName: \"kubernetes.io/projected/da4847b6-4537-4d72-a655-01dbb0e7646a-kube-api-access-qbqbk\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"da4847b6-4537-4d72-a655-01dbb0e7646a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:23.957259 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.957246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqhtw\" (UniqueName: \"kubernetes.io/projected/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-kube-api-access-wqhtw\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:23.958322 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.958198 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjb9n\" (UniqueName: \"kubernetes.io/projected/6a5dd3bc-aac4-4b46-8cad-fc5762c812a4-kube-api-access-kjb9n\") pod \"multus-sm766\" (UID: \"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4\") " pod="openshift-multus/multus-sm766" Jul 18 00:40:23.963817 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.963754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" event={"ID":"e2b1c5a1c951ba2dea802fc68a7b0c0f","Type":"ContainerStarted","Data":"4e3ba67fd01e2c4e914ceabdfd495de09d678746ed8269eeb8c717e886a56640"} Jul 18 00:40:23.964824 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:23.964799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" event={"ID":"190049d7968bdc78972d2e10f65e43fd","Type":"ContainerStarted","Data":"bcc1c9e3ce86b65d3bfa32e0fbe221253f7d025a45364829af7e73385d18d493"} Jul 18 00:40:24.037157 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6745688-c862-4ba3-bbd2-6a5cb0335dde-agent-certs\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:24.037157 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-kubelet-config\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-dbus\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123ca7fe-59f2-4012-88f1-a755b47e1ffb-host\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-kubelet-config\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmbx\" (UniqueName: \"kubernetes.io/projected/123ca7fe-59f2-4012-88f1-a755b47e1ffb-kube-api-access-jtmbx\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6745688-c862-4ba3-bbd2-6a5cb0335dde-konnectivity-ca\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21bc05e7-e356-4707-b3e4-b336dc39e1da-dbus\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.037439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123ca7fe-59f2-4012-88f1-a755b47e1ffb-serviceca\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.037789 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.037789 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/123ca7fe-59f2-4012-88f1-a755b47e1ffb-host\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.037789 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.037634 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:24.037789 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.037687 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:24.537672427 +0000 UTC m=+3.072555394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:24.037951 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.037930 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/123ca7fe-59f2-4012-88f1-a755b47e1ffb-serviceca\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.038023 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.038007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e6745688-c862-4ba3-bbd2-6a5cb0335dde-konnectivity-ca\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:24.040384 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.040358 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e6745688-c862-4ba3-bbd2-6a5cb0335dde-agent-certs\") pod \"konnectivity-agent-tcwbt\" (UID: \"e6745688-c862-4ba3-bbd2-6a5cb0335dde\") " pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:24.047116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.047039 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:24.047116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.047070 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:24.047116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.047083 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:24.047314 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.047169 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:24.547139142 +0000 UTC m=+3.082022124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:24.050438 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.050398 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmbx\" (UniqueName: \"kubernetes.io/projected/123ca7fe-59f2-4012-88f1-a755b47e1ffb-kube-api-access-jtmbx\") pod \"node-ca-slv4q\" (UID: \"123ca7fe-59f2-4012-88f1-a755b47e1ffb\") " pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.117368 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.117337 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:24.124931 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.124892 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:24.135298 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.135269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znnm9" Jul 18 00:40:24.144777 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.144739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sm766" Jul 18 00:40:24.150687 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.150660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" Jul 18 00:40:24.159960 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.159930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" Jul 18 00:40:24.169969 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.169934 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k4h22" Jul 18 00:40:24.188149 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.188118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" Jul 18 00:40:24.194456 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.194430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:24.200717 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.200691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slv4q" Jul 18 00:40:24.441352 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.441310 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:24.441538 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.441480 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:24.441602 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.441590 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:25.441573455 +0000 UTC m=+3.976456425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:24.542496 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.542438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:24.542699 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.542615 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:24.542699 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.542696 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:25.542673199 +0000 UTC m=+4.077556171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:24.643444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.643335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:24.643613 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.643533 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:24.643613 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.643555 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:24.643613 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.643601 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:24.643732 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.643655 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:25.643640801 +0000 UTC m=+4.178523771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:24.868459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.868379 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:24 +0000 UTC" deadline="2028-01-23 20:11:05.067344873 +0000 UTC" Jul 18 00:40:24.868459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.868452 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13315h30m40.198896797s" Jul 18 00:40:24.959284 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:24.959210 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:24.959415 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:24.959329 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:24.995480 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:24.995400 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2418eab_d788_463b_8352_81f7f20a850c.slice/crio-9e5477b016cb69bfa04f8077d55350f755a33e07f50f671db1ffcf764a8a5eec WatchSource:0}: Error finding container 9e5477b016cb69bfa04f8077d55350f755a33e07f50f671db1ffcf764a8a5eec: Status 404 returned error can't find the container with id 9e5477b016cb69bfa04f8077d55350f755a33e07f50f671db1ffcf764a8a5eec Jul 18 00:40:25.003784 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:25.003748 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6745688_c862_4ba3_bbd2_6a5cb0335dde.slice/crio-dadb71d598c158111f04236aae6a3928e0c16bee1ce9079786c55a351690910d WatchSource:0}: Error finding container dadb71d598c158111f04236aae6a3928e0c16bee1ce9079786c55a351690910d: Status 404 returned error can't find the container with id dadb71d598c158111f04236aae6a3928e0c16bee1ce9079786c55a351690910d Jul 18 00:40:25.004081 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:25.004061 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4847b6_4537_4d72_a655_01dbb0e7646a.slice/crio-5db6869467eab23d8b329a51baacfed4d5e9ac856ca6d640693f5e82b1963dd5 WatchSource:0}: Error finding container 5db6869467eab23d8b329a51baacfed4d5e9ac856ca6d640693f5e82b1963dd5: Status 404 returned error can't find the container with id 5db6869467eab23d8b329a51baacfed4d5e9ac856ca6d640693f5e82b1963dd5 Jul 18 00:40:25.005431 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:25.005400 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a98e723_b54e_4254_8261_a3fffacdd887.slice/crio-39df813bc5349eae3baac7865cf484f543ee9c5c6db1fd61c509a97bf0d70f53 WatchSource:0}: Error finding container 39df813bc5349eae3baac7865cf484f543ee9c5c6db1fd61c509a97bf0d70f53: Status 404 returned error can't find the container with id 39df813bc5349eae3baac7865cf484f543ee9c5c6db1fd61c509a97bf0d70f53 Jul 18 00:40:25.013096 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:25.012206 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5dd3bc_aac4_4b46_8cad_fc5762c812a4.slice/crio-5844d284817c7f140a170f669f97555c36cf2f97ebfe4b7329aab479995b3820 WatchSource:0}: Error finding container 5844d284817c7f140a170f669f97555c36cf2f97ebfe4b7329aab479995b3820: Status 404 returned error can't find the container with id 5844d284817c7f140a170f669f97555c36cf2f97ebfe4b7329aab479995b3820 Jul 18 00:40:25.450175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.449900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:25.450365 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.450172 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:25.450365 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.450278 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:27.450255205 +0000 UTC m=+5.985138186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:25.551250 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.551155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:25.551432 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.551330 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:25.551432 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.551396 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:27.551377598 +0000 UTC m=+6.086260568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:25.652344 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.652299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:25.652582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.652550 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:25.652582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.652577 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:25.652697 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.652591 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:25.652697 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.652652 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:27.652632232 +0000 UTC m=+6.187515206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:25.869319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.869268 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:24 +0000 UTC" deadline="2028-01-05 03:33:11.374319309 +0000 UTC" Jul 18 00:40:25.869319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.869316 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12866h52m45.505008152s" Jul 18 00:40:25.962040 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.962004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:25.962216 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.962154 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:25.962216 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.962168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:25.962346 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:25.962247 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:25.997274 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:25.997229 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" event={"ID":"168265b4-47f2-4929-8cec-d37d893dc4bc","Type":"ContainerStarted","Data":"4007c9998d57d35ba0269ea2db55caa55b431c4e7da219d33d1c3e18b65963c9"} Jul 18 00:40:26.006388 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.006341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slv4q" event={"ID":"123ca7fe-59f2-4012-88f1-a755b47e1ffb","Type":"ContainerStarted","Data":"aa4947ace2ad1a8a1c61524be34407847021c315e094b483d952b085395e458e"} Jul 18 00:40:26.017350 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.017225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"1c77266cd808fd968e2f15f9f54094090b304e50a9f79e61b99419bfd727a975"} Jul 18 00:40:26.028360 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.028292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znnm9" event={"ID":"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5","Type":"ContainerStarted","Data":"adc2ea4eedd9b9bf516bdde7f7129f90a96a71ace257c6f85f6adf5c14e4e1d7"} Jul 18 00:40:26.034143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.034099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k4h22" event={"ID":"f2418eab-d788-463b-8352-81f7f20a850c","Type":"ContainerStarted","Data":"9e5477b016cb69bfa04f8077d55350f755a33e07f50f671db1ffcf764a8a5eec"} Jul 18 00:40:26.056666 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.056620 2577 generic.go:356] "Generic (PLEG): container finished" podID="190049d7968bdc78972d2e10f65e43fd" containerID="86896893b82a24859dc7d329cf39158033f11030c0d27965c540e68462e9bfbc" exitCode=0 Jul 18 00:40:26.056853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.056746 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" event={"ID":"190049d7968bdc78972d2e10f65e43fd","Type":"ContainerDied","Data":"86896893b82a24859dc7d329cf39158033f11030c0d27965c540e68462e9bfbc"} Jul 18 00:40:26.068132 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.067920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerStarted","Data":"39df813bc5349eae3baac7865cf484f543ee9c5c6db1fd61c509a97bf0d70f53"} Jul 18 00:40:26.081741 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.081705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"da4847b6-4537-4d72-a655-01dbb0e7646a","Type":"ContainerStarted","Data":"5db6869467eab23d8b329a51baacfed4d5e9ac856ca6d640693f5e82b1963dd5"} Jul 18 00:40:26.092709 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.092588 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tcwbt" event={"ID":"e6745688-c862-4ba3-bbd2-6a5cb0335dde","Type":"ContainerStarted","Data":"dadb71d598c158111f04236aae6a3928e0c16bee1ce9079786c55a351690910d"} Jul 18 00:40:26.116294 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.116247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" event={"ID":"e2b1c5a1c951ba2dea802fc68a7b0c0f","Type":"ContainerStarted","Data":"c024bcde44bafe4b30d212a22fd8e03fb4404aaf77fd2f2b8cb51ef876ef2446"} Jul 18 00:40:26.139303 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.139169 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm766" event={"ID":"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4","Type":"ContainerStarted","Data":"5844d284817c7f140a170f669f97555c36cf2f97ebfe4b7329aab479995b3820"} Jul 18 00:40:26.959914 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:26.959329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:26.959914 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:26.959496 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:27.178767 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.178716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" event={"ID":"190049d7968bdc78972d2e10f65e43fd","Type":"ContainerStarted","Data":"95983f331e0e78eeeae8358bb05211a255bee7cdf6799bfe239b4ba79cd1ccb7"} Jul 18 00:40:27.195007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.194924 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-82.ec2.internal" podStartSLOduration=4.194899708 podStartE2EDuration="4.194899708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:26.131409618 +0000 UTC m=+4.666292612" watchObservedRunningTime="2026-07-18 00:40:27.194899708 +0000 UTC m=+5.729782701" Jul 18 00:40:27.469496 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.469449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:27.469728 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.469698 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:27.469801 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.469774 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:31.46975359 +0000 UTC m=+10.004636561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:27.570934 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.570890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:27.571115 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.571071 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:27.571197 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.571142 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:31.571121382 +0000 UTC m=+10.106004374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:27.672148 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.672100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:27.672356 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.672340 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:27.672441 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.672361 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:27.672441 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.672374 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:27.672441 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.672437 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:31.672417063 +0000 UTC m=+10.207300033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:27.962330 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.961497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:27.962330 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.961658 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:27.962330 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:27.962064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:27.962330 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:27.962164 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:28.958920 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:28.958878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:28.959138 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:28.959020 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:29.960606 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:29.959660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:29.960606 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:29.959810 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:29.960606 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:29.960234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:29.960606 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:29.960341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:30.959186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:30.959149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:30.959367 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:30.959270 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:31.514141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:31.514098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:31.514604 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.514274 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:31.514604 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.514334 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.51432005 +0000 UTC m=+18.049203016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:31.615262 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:31.615206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:31.615446 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.615391 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:31.615535 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.615471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.615448093 +0000 UTC m=+18.150331074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:31.715649 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:31.715599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:31.715880 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.715853 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:31.715880 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.715884 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:31.716093 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.715900 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:31.716093 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.715966 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.715945306 +0000 UTC m=+18.250828276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:31.960054 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:31.960011 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:31.960220 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.960130 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:31.960730 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:31.960703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:31.960845 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:31.960823 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:32.959214 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:32.959177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:32.959761 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:32.959331 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:33.959204 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:33.959119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:33.959365 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:33.959226 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:33.959804 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:33.959699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:33.959881 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:33.959814 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:34.959707 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:34.959668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:34.960174 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:34.959814 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:35.959649 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:35.959610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:35.959839 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:35.959610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:35.959839 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:35.959756 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:35.960244 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:35.959834 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:36.959478 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:36.959430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:36.959685 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:36.959601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:37.959965 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:37.959695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:37.959965 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:37.959825 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:37.959965 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:37.959860 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:37.959965 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:37.959937 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:38.959331 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:38.959289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:38.959649 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:38.959427 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:39.577430 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:39.577397 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:39.577855 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.577554 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:39.577855 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.577620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:40:55.577600749 +0000 UTC m=+34.112483716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:39.678554 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:39.678515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:39.678750 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.678731 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:39.678831 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.678816 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:40:55.678794972 +0000 UTC m=+34.213677954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:39.778934 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:39.778896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:39.779134 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.779042 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:39.779134 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.779064 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:39.779134 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.779077 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:39.779234 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.779144 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:40:55.779130906 +0000 UTC m=+34.314013870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:39.959755 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:39.959640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:39.959937 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.959795 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:39.959937 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:39.959862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:39.960043 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:39.959993 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:40.959529 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:40.959472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:40.960010 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:40.959631 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:41.960015 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:41.959974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:41.960428 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:41.960097 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:41.960428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:41.960144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:41.960428 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:41.960261 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:42.959230 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:42.959191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:42.959419 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:42.959341 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:43.959892 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:43.959857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:43.960408 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:43.959858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:43.960408 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:43.960002 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:43.960408 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:43.960107 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:44.959767 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:44.959440 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:44.959927 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:44.959875 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:45.219668 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.219635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sm766" event={"ID":"6a5dd3bc-aac4-4b46-8cad-fc5762c812a4","Type":"ContainerStarted","Data":"8f75b9b1f4b6592df6ad6c38b8a00634a5d2300cb3baf2f56b4244a0abe26aad"} Jul 18 00:40:45.221569 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.221440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" event={"ID":"168265b4-47f2-4929-8cec-d37d893dc4bc","Type":"ContainerStarted","Data":"bb7f7c60b893a9bf2e3dba889917fecbefc254ce001c9063acd080b3d86363e3"} Jul 18 00:40:45.227381 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.227348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slv4q" event={"ID":"123ca7fe-59f2-4012-88f1-a755b47e1ffb","Type":"ContainerStarted","Data":"31fd8844785d0893dfc70f7c09bfe2ec421d22fe4e59e07116c58366596dde73"} Jul 18 00:40:45.230058 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"8b0782bb2ef71cf13c2764e5ba702253200a37696674cfd52db5df1694b56e86"} Jul 18 00:40:45.230210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"efaab7d9ec743e43974df4df096904dfaf77989a92444921946fc2f83f23a97a"} Jul 18 00:40:45.230210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"e5836bac97a30fdccb28c1712badbcd18cd1b706da5b8827b83464de589170cf"} Jul 18 00:40:45.230210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"baa4780add90e5b6f1c9f6ddd644fec511fc34ecb0606627a0c8a8ec6d18c8a9"} Jul 18 00:40:45.230358 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"6144f7a54a8eedcad1c97dee36caf988b18cca5d9d828b2da8c81ee0f72735ee"} Jul 18 00:40:45.230358 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.230279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"3ae8e20497209434949800d760f05e40956f7368ae24321629bbce0e17ef6a59"} Jul 18 00:40:45.231328 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.231303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znnm9" event={"ID":"d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5","Type":"ContainerStarted","Data":"1090eef6c7c897247f3de4fa8d3806e9fde4d893fb141a906249577513bae132"} Jul 18 00:40:45.232764 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.232741 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="b3097c8895d470183b0265b15eb404b26e98693f2da92196f8215f7d9028d0ac" exitCode=0 Jul 18 00:40:45.232872 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.232808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"b3097c8895d470183b0265b15eb404b26e98693f2da92196f8215f7d9028d0ac"} Jul 18 00:40:45.234304 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.234279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"da4847b6-4537-4d72-a655-01dbb0e7646a","Type":"ContainerStarted","Data":"e9890d917e611ed40778ff8984bf8bae498e73e00d056d0f207917ed6c5d7c07"} Jul 18 00:40:45.235635 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.235610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tcwbt" event={"ID":"e6745688-c862-4ba3-bbd2-6a5cb0335dde","Type":"ContainerStarted","Data":"8a224fbee60f8f964a832e2a96cf8a9eb8a8217f16359cf4a2198d792d46fd75"} Jul 18 00:40:45.237007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.236974 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-82.ec2.internal" podStartSLOduration=22.23696236 podStartE2EDuration="22.23696236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:27.194750939 +0000 UTC m=+5.729633942" watchObservedRunningTime="2026-07-18 00:40:45.23696236 +0000 UTC m=+23.771845345" Jul 18 00:40:45.237116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.237099 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sm766" podStartSLOduration=4.050115514 podStartE2EDuration="23.237094115s" totalImagesPullingTime="19.186978601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:45.236667979 +0000 UTC m=+23.771550963" watchObservedRunningTime="2026-07-18 00:40:45.237094115 +0000 UTC m=+23.771977101" Jul 18 00:40:45.274427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.274368 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ghrt2" podStartSLOduration=3.131504676 podStartE2EDuration="22.27435037s" totalImagesPullingTime="19.142845694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:45.27422367 +0000 UTC m=+23.809106656" watchObservedRunningTime="2026-07-18 00:40:45.27435037 +0000 UTC m=+23.809233356" Jul 18 00:40:45.291666 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.291625 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tcwbt" podStartSLOduration=10.987784533 podStartE2EDuration="22.291609604s" totalImagesPullingTime="11.303825071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:45.291292646 +0000 UTC m=+23.826175633" watchObservedRunningTime="2026-07-18 00:40:45.291609604 +0000 UTC m=+23.826492590" Jul 18 00:40:45.339657 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.339605 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znnm9" podStartSLOduration=4.1893289750000005 podStartE2EDuration="23.339589358s" totalImagesPullingTime="19.150260383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:45.339220878 +0000 UTC m=+23.874103864" watchObservedRunningTime="2026-07-18 00:40:45.339589358 +0000 UTC m=+23.874472343" Jul 18 00:40:45.339819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.339674 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-slv4q" podStartSLOduration=3.197576609 podStartE2EDuration="22.339670054s" totalImagesPullingTime="19.142093445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:45.311096648 +0000 UTC m=+23.845979633" watchObservedRunningTime="2026-07-18 00:40:45.339670054 +0000 UTC m=+23.874553039" Jul 18 00:40:45.521013 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.520983 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 00:40:45.884627 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.884498 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:40:45.521006274Z","UUID":"da662bd4-7028-408a-9bb6-882ef8eecdec","Handler":null,"Name":"","Endpoint":""} Jul 18 00:40:45.886731 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.886705 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 00:40:45.886731 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.886752 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 00:40:45.959042 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.959001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:45.959285 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:45.959131 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:45.959668 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:45.959649 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:45.959777 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:45.959749 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:46.241102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:46.241010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"da4847b6-4537-4d72-a655-01dbb0e7646a","Type":"ContainerStarted","Data":"e033ee17a7079add1c01543039c7f6e09dc94de34f0c96b1e0834ad9e3e1ae70"} Jul 18 00:40:46.243249 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:46.243216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k4h22" event={"ID":"f2418eab-d788-463b-8352-81f7f20a850c","Type":"ContainerStarted","Data":"11205093625cbe4384f1ac635d5583f618fba5a1e655e5b9cf5d86375b60ec47"} Jul 18 00:40:46.257544 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:46.257473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k4h22" podStartSLOduration=5.106544789 podStartE2EDuration="24.257450866s" totalImagesPullingTime="19.150906077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:46.257092225 +0000 UTC m=+24.791975210" watchObservedRunningTime="2026-07-18 00:40:46.257450866 +0000 UTC m=+24.792333854" Jul 18 00:40:46.959801 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:46.959764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:46.959978 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:46.959926 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:47.247891 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.247801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"da4847b6-4537-4d72-a655-01dbb0e7646a","Type":"ContainerStarted","Data":"566839bbaeb3b9d369ca1e49d2ed9ea478b7f605edb6492a5c89dcb144aac3df"} Jul 18 00:40:47.251584 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.251527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"d2475e13405ab4ae9986768c1c73a89c1dc6a1447d4658954abba6f881961b30"} Jul 18 00:40:47.265006 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.264955 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" podStartSLOduration=4.019487149 podStartE2EDuration="25.264938972s" totalImagesPullingTime="21.245451823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:47.26453268 +0000 UTC m=+25.799415666" watchObservedRunningTime="2026-07-18 00:40:47.264938972 +0000 UTC m=+25.799821959" Jul 18 00:40:47.347229 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.347195 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:47.347837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.347816 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:47.959442 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.959408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:47.959650 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:47.959542 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:47.959650 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:47.959605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:47.959750 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:47.959721 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:48.959543 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:48.959326 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:48.959947 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:48.959646 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:49.964867 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:49.962976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:49.964867 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:49.963370 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:49.964867 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:49.963852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:49.964867 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:49.963978 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:50.261785 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.261691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" event={"ID":"676041f7-b064-4cda-9ba6-7c78b5fe9202","Type":"ContainerStarted","Data":"d4a6b6097b06621caddd7362d7e720a1d9ac244adb2fc6bf0192b966340c14cd"} Jul 18 00:40:50.262080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.261942 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:50.262080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.261988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:50.263573 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.263539 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="ee28675f1b91365d5321494ed1a98483000a7a530572cfc20e3161a6034989bb" exitCode=0 Jul 18 00:40:50.263700 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.263587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"ee28675f1b91365d5321494ed1a98483000a7a530572cfc20e3161a6034989bb"} Jul 18 00:40:50.278859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.278822 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:50.343299 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.343252 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" podStartSLOduration=9.126782711 podStartE2EDuration="28.34323673s" totalImagesPullingTime="19.216454019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:50.29983944 +0000 UTC m=+28.834722425" watchObservedRunningTime="2026-07-18 00:40:50.34323673 +0000 UTC m=+28.878119745" Jul 18 00:40:50.959059 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:50.959027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:50.959326 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:50.959136 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:51.142292 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.142261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:51.142742 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.142400 2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 18 00:40:51.142940 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.142923 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tcwbt" Jul 18 00:40:51.266323 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.266240 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:51.281905 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.281877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:40:51.333931 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.333887 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggk8j"] Jul 18 00:40:51.334136 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.334064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:51.334214 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:51.334183 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:51.336933 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.336899 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hw6bp"] Jul 18 00:40:51.337091 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.337020 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:51.337160 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:51.337117 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:51.337507 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.337469 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwvtd"] Jul 18 00:40:51.337603 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:51.337573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:51.337678 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:51.337655 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:52.269997 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:52.269963 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="30ecfc1e7cd57eabab118d1fdf174798b3a631eaa1370f988825bc1c355e43e2" exitCode=0 Jul 18 00:40:52.270442 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:52.270059 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"30ecfc1e7cd57eabab118d1fdf174798b3a631eaa1370f988825bc1c355e43e2"} Jul 18 00:40:52.959648 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:52.959595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:52.959648 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:52.959621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:52.959648 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:52.959595 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:52.959949 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:52.959732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:52.959949 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:52.959793 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:52.959949 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:52.959863 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:54.276803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:54.276592 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="1925b67eb7ad7bad5deae799f7e020d27379cc67efdb82b6d3d5e484fcdb03db" exitCode=0 Jul 18 00:40:54.276803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:54.276672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"1925b67eb7ad7bad5deae799f7e020d27379cc67efdb82b6d3d5e484fcdb03db"} Jul 18 00:40:54.959564 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:54.959527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:54.959756 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:54.959535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:54.959756 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:54.959648 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kwvtd" podUID="21bc05e7-e356-4707-b3e4-b336dc39e1da" Jul 18 00:40:54.959756 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:54.959660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:54.959920 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:54.959753 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hw6bp" podUID="9aa52f32-9aba-4b41-b326-3f16a488677f" Jul 18 00:40:54.959920 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:54.959832 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:40:55.596012 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:55.595962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:55.596424 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.596102 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:55.596424 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.596166 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:41:27.596149939 +0000 UTC m=+66.131032906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:55.696723 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:55.696687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:55.696914 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.696863 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:55.696977 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.696939 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret podName:21bc05e7-e356-4707-b3e4-b336dc39e1da nodeName:}" failed. No retries permitted until 2026-07-18 00:41:27.696919437 +0000 UTC m=+66.231802401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret") pod "global-pull-secret-syncer-kwvtd" (UID: "21bc05e7-e356-4707-b3e4-b336dc39e1da") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:55.797911 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:55.797880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:55.798081 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.798059 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:55.798157 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.798085 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:55.798157 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.798095 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sf7qv for pod openshift-network-diagnostics/network-check-target-hw6bp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:55.798157 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:55.798153 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv podName:9aa52f32-9aba-4b41-b326-3f16a488677f nodeName:}" failed. No retries permitted until 2026-07-18 00:41:27.798134983 +0000 UTC m=+66.333017964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf7qv" (UniqueName: "kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv") pod "network-check-target-hw6bp" (UID: "9aa52f32-9aba-4b41-b326-3f16a488677f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:56.760195 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.760167 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-82.ec2.internal" event="NodeReady" Jul 18 00:40:56.760742 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.760321 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 00:40:56.793910 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.793866 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:40:56.796210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.796186 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq"] Jul 18 00:40:56.796351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.796324 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.798140 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.798119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:56.798905 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.798876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 18 00:40:56.798905 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.798887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 18 00:40:56.799093 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.798878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lrgc9\"" Jul 18 00:40:56.799093 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.798990 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 18 00:40:56.801617 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.801595 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 18 00:40:56.801724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.801595 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9q97z\"" Jul 18 00:40:56.801724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.801598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 18 00:40:56.806607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.805875 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 18 00:40:56.806683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.806635 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq"] Jul 18 00:40:56.816448 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.816419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:40:56.819121 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.819094 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vhcnk"] Jul 18 00:40:56.821746 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.821712 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-btfk5"] Jul 18 00:40:56.821996 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.821974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:56.823467 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.823449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:56.824609 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.824536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 00:40:56.824724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.824661 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 00:40:56.824724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.824707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\"" Jul 18 00:40:56.825878 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.825852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jgd\"" Jul 18 00:40:56.826007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.825902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 00:40:56.826007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.825908 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 00:40:56.826200 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.826178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 00:40:56.830273 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.830251 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btfk5"] Jul 18 00:40:56.836989 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.834508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vhcnk"] Jul 18 00:40:56.905819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.905819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:56.905819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d312b42-1264-40e8-95be-91339ee220a0-cert\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:56.905819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.905932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5cl\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7811bca7-53b7-455a-8a24-ac1f41c9d47c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906076 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-tmp-dir\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906199 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7jtz\" (UniqueName: \"kubernetes.io/projected/4d312b42-1264-40e8-95be-91339ee220a0-kube-api-access-c7jtz\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-config-volume\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906253 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29bz4\" (UniqueName: \"kubernetes.io/projected/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-kube-api-access-29bz4\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:56.906363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.906329 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:56.959056 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.959009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:40:56.959246 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.959026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:40:56.959246 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.959027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:40:56.961854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.961829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:40:56.962008 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.961837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:40:56.962008 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.961901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:40:56.962008 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.961837 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\"" Jul 18 00:40:56.962171 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.962040 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:40:56.962263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:56.962251 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\"" Jul 18 00:40:57.007443 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.007653 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7jtz\" (UniqueName: \"kubernetes.io/projected/4d312b42-1264-40e8-95be-91339ee220a0-kube-api-access-c7jtz\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:57.007653 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-config-volume\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.007767 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29bz4\" (UniqueName: \"kubernetes.io/projected/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-kube-api-access-29bz4\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.007767 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:57.007767 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d312b42-1264-40e8-95be-91339ee220a0-cert\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5cl\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.007898 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.007893 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.007949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7811bca7-53b7-455a-8a24-ac1f41c9d47c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.007974 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:57.507952174 +0000 UTC m=+36.042835152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-tmp-dir\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.008175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.008564 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.008719 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008591 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7811bca7-53b7-455a-8a24-ac1f41c9d47c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:57.008719 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.008600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.009458 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.009430 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-tmp-dir\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.009577 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.009528 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:40:57.009577 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.009542 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:40:57.009676 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.009593 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:57.509578025 +0000 UTC m=+36.044460991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:40:57.009676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.009626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.009676 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.009662 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:40:57.009811 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.009693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:40:57.509683421 +0000 UTC m=+36.044566385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:40:57.009811 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.009690 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-config-volume\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.013351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.013328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.013351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.013349 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.014303 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.013936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d312b42-1264-40e8-95be-91339ee220a0-cert\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:57.017984 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.016868 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5cl\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.019405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.019374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7jtz\" (UniqueName: \"kubernetes.io/projected/4d312b42-1264-40e8-95be-91339ee220a0-kube-api-access-c7jtz\") pod \"ingress-canary-btfk5\" (UID: \"4d312b42-1264-40e8-95be-91339ee220a0\") " pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:57.020994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.020970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.021104 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.021001 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29bz4\" (UniqueName: \"kubernetes.io/projected/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-kube-api-access-29bz4\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.142425 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.142390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-btfk5" Jul 18 00:40:57.512217 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.512179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:57.512390 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.512238 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:57.512390 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:57.512269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:57.512390 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512353 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512391 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512405 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512422 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512432 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:58.512411625 +0000 UTC m=+37.047294614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512451 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:58.512442544 +0000 UTC m=+37.047325509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:40:57.512568 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:57.512471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:40:58.512455421 +0000 UTC m=+37.047338391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:40:58.216112 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.215918 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-btfk5"] Jul 18 00:40:58.220517 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:40:58.220473 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d312b42_1264_40e8_95be_91339ee220a0.slice/crio-b0e6f5a39f9cc44dd84f02c38821152d6e0abee9ef3ebf0cf5382039d4db6b34 WatchSource:0}: Error finding container b0e6f5a39f9cc44dd84f02c38821152d6e0abee9ef3ebf0cf5382039d4db6b34: Status 404 returned error can't find the container with id b0e6f5a39f9cc44dd84f02c38821152d6e0abee9ef3ebf0cf5382039d4db6b34 Jul 18 00:40:58.290993 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.290935 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerStarted","Data":"fe5b87846c9c7b81f763ed096bbb0748b56002c964a7a84168ff23eac46bdc86"} Jul 18 00:40:58.292629 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.292606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btfk5" event={"ID":"4d312b42-1264-40e8-95be-91339ee220a0","Type":"ContainerStarted","Data":"b0e6f5a39f9cc44dd84f02c38821152d6e0abee9ef3ebf0cf5382039d4db6b34"} Jul 18 00:40:58.519460 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.519341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:40:58.519460 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.519390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:40:58.519460 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:58.519409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519519 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519537 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519562 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519585 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.519570729 +0000 UTC m=+39.054453693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519517 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519606 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.519594416 +0000 UTC m=+39.054477383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:40:58.519686 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:40:58.519648 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:00.519637237 +0000 UTC m=+39.054520204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:40:59.298428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:59.298391 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="fe5b87846c9c7b81f763ed096bbb0748b56002c964a7a84168ff23eac46bdc86" exitCode=0 Jul 18 00:40:59.298854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:40:59.298457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"fe5b87846c9c7b81f763ed096bbb0748b56002c964a7a84168ff23eac46bdc86"} Jul 18 00:41:00.304370 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:00.304329 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a98e723-b54e-4254-8261-a3fffacdd887" containerID="b8e5008d3bb22d334277d4bdcb6e2987280e85fde3627f749cc37d73309f8cc1" exitCode=0 Jul 18 00:41:00.304866 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:00.304387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerDied","Data":"b8e5008d3bb22d334277d4bdcb6e2987280e85fde3627f749cc37d73309f8cc1"} Jul 18 00:41:00.536839 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:00.536789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:41:00.537019 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:00.536857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:41:00.537019 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:00.536885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:41:00.537127 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537061 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:00.537127 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537120 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:41:04.537103865 +0000 UTC m=+43.071986847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:41:00.537593 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537570 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:41:00.537691 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537599 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:41:00.537691 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537613 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:41:00.537691 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537634 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:04.537618077 +0000 UTC m=+43.072501062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:41:00.537691 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:00.537650 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:04.537639443 +0000 UTC m=+43.072522411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:41:01.309028 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:01.308994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-btfk5" event={"ID":"4d312b42-1264-40e8-95be-91339ee220a0","Type":"ContainerStarted","Data":"34140ebd860ff9d4bf1b9806efc19a0204fe1e42aefbd1ef1e19cf0b783284bd"} Jul 18 00:41:01.312624 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:01.312599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" event={"ID":"8a98e723-b54e-4254-8261-a3fffacdd887","Type":"ContainerStarted","Data":"9c607838ef0fd89a49d6f5c5cca65b3d9acb6a01437f87a0380e0bd5ba157921"} Jul 18 00:41:01.324845 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:01.324798 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-btfk5" podStartSLOduration=2.567676611 podStartE2EDuration="5.324783189s" totalImagesPullingTime="2.757106578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:01.323066824 +0000 UTC m=+39.857949836" watchObservedRunningTime="2026-07-18 00:41:01.324783189 +0000 UTC m=+39.859666175" Jul 18 00:41:01.360642 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:01.360441 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9gbq" podStartSLOduration=9.993356309 podStartE2EDuration="39.360419151s" totalImagesPullingTime="29.367062842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:01.358448132 +0000 UTC m=+39.893331118" watchObservedRunningTime="2026-07-18 00:41:01.360419151 +0000 UTC m=+39.895302137" Jul 18 00:41:04.570116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:04.570071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:41:04.570116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:04.570122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:04.570143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570231 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570298 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:12.570282097 +0000 UTC m=+51.105165062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570234 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:41:12.570353781 +0000 UTC m=+51.105236746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570233 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570383 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:41:04.570582 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:04.570406 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:12.570399957 +0000 UTC m=+51.105282921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:41:12.632776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:12.632730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:41:12.632776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:12.632777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:12.632802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632901 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632906 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632933 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632901 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632968 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:28.632949539 +0000 UTC m=+67.167832519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:28.632978608 +0000 UTC m=+67.167861573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:41:12.633288 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:12.632996 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:41:28.632991439 +0000 UTC m=+67.167874403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:41:23.292984 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:23.292957 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9v62v" Jul 18 00:41:27.639440 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.639401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:41:27.642038 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.642018 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:41:27.650138 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:27.650107 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 00:41:27.650217 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:27.650191 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:42:31.650173284 +0000 UTC m=+130.185056248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : secret "metrics-daemon-secret" not found Jul 18 00:41:27.740640 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.740604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:41:27.743251 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.743230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:41:27.755270 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.755242 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21bc05e7-e356-4707-b3e4-b336dc39e1da-original-pull-secret\") pod \"global-pull-secret-syncer-kwvtd\" (UID: \"21bc05e7-e356-4707-b3e4-b336dc39e1da\") " pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:41:27.841698 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.841666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:41:27.844374 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.844357 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:41:27.855216 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.855195 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:41:27.865264 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.865232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf7qv\" (UniqueName: \"kubernetes.io/projected/9aa52f32-9aba-4b41-b326-3f16a488677f-kube-api-access-sf7qv\") pod \"network-check-target-hw6bp\" (UID: \"9aa52f32-9aba-4b41-b326-3f16a488677f\") " pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:41:27.870986 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.870964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kwvtd" Jul 18 00:41:27.885084 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.885057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\"" Jul 18 00:41:27.893285 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:27.893204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:41:28.021143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.021110 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kwvtd"] Jul 18 00:41:28.024401 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:41:28.024371 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bc05e7_e356_4707_b3e4_b336dc39e1da.slice/crio-7fbd3e319b37c0da07baeca0be9bcb1c261737059d323ab699d2bd6b68d35f96 WatchSource:0}: Error finding container 7fbd3e319b37c0da07baeca0be9bcb1c261737059d323ab699d2bd6b68d35f96: Status 404 returned error can't find the container with id 7fbd3e319b37c0da07baeca0be9bcb1c261737059d323ab699d2bd6b68d35f96 Jul 18 00:41:28.053048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.053006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hw6bp"] Jul 18 00:41:28.055296 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:41:28.055268 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa52f32_9aba_4b41_b326_3f16a488677f.slice/crio-b14e657b326ebef72aa9f911f8800266840743ec923452ed5c2f91a54de9b228 WatchSource:0}: Error finding container b14e657b326ebef72aa9f911f8800266840743ec923452ed5c2f91a54de9b228: Status 404 returned error can't find the container with id b14e657b326ebef72aa9f911f8800266840743ec923452ed5c2f91a54de9b228 Jul 18 00:41:28.377574 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.377539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hw6bp" event={"ID":"9aa52f32-9aba-4b41-b326-3f16a488677f","Type":"ContainerStarted","Data":"b14e657b326ebef72aa9f911f8800266840743ec923452ed5c2f91a54de9b228"} Jul 18 00:41:28.378537 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.378477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwvtd" event={"ID":"21bc05e7-e356-4707-b3e4-b336dc39e1da","Type":"ContainerStarted","Data":"7fbd3e319b37c0da07baeca0be9bcb1c261737059d323ab699d2bd6b68d35f96"} Jul 18 00:41:28.649345 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.649251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:41:28.649345 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.649311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:41:28.649345 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:28.649340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649431 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649432 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:42:00.649502052 +0000 UTC m=+99.184385031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649539 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:42:00.649529642 +0000 UTC m=+99.184412609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649565 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649576 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:41:28.649876 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:41:28.649606 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:42:00.649596112 +0000 UTC m=+99.184479076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:41:33.397284 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:33.397248 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kwvtd" event={"ID":"21bc05e7-e356-4707-b3e4-b336dc39e1da","Type":"ContainerStarted","Data":"ee3597b9cd88c1a1aba358d1171f97b1612b26278818f5121ceb67190d932642"} Jul 18 00:41:33.398781 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:33.398754 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hw6bp" event={"ID":"9aa52f32-9aba-4b41-b326-3f16a488677f","Type":"ContainerStarted","Data":"017402379ab14b287ce6f0efc3866848578c79d837dbcb24c4171a5315b82bfe"} Jul 18 00:41:33.398918 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:33.398901 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:41:33.428219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:33.428158 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kwvtd" podStartSLOduration=65.889836674 podStartE2EDuration="1m10.428140197s" totalImagesPullingTime="4.538303523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:33.410818006 +0000 UTC m=+71.945700992" watchObservedRunningTime="2026-07-18 00:41:33.428140197 +0000 UTC m=+71.963023183" Jul 18 00:41:33.428633 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:41:33.428607 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hw6bp" podStartSLOduration=65.924805178 podStartE2EDuration="1m10.428598988s" totalImagesPullingTime="4.50379381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:33.428365351 +0000 UTC m=+71.963248336" watchObservedRunningTime="2026-07-18 00:41:33.428598988 +0000 UTC m=+71.963481973" Jul 18 00:42:00.685994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:42:00.685830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:42:00.685994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:42:00.685887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:42:00.685994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:42:00.685907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:42:00.685994 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.685999 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:42:00.685994 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686001 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:42:00.686635 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686054 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:43:04.686041098 +0000 UTC m=+163.220924062 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:42:00.686635 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:43:04.686060392 +0000 UTC m=+163.220943359 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:42:00.686635 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686005 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:42:00.686635 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686100 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:42:00.686635 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:00.686154 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:43:04.68614125 +0000 UTC m=+163.221024232 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:42:04.403461 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:42:04.403421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hw6bp" Jul 18 00:42:31.712619 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:42:31.712565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:42:31.713198 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:31.712771 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 00:42:31.713198 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:31.712859 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:44:33.712837033 +0000 UTC m=+252.247720014 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : secret "metrics-daemon-secret" not found Jul 18 00:42:59.809588 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:59.809528 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6477947558-8vs46" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" Jul 18 00:42:59.816778 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:59.816755 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" podUID="7811bca7-53b7-455a-8a24-ac1f41c9d47c" Jul 18 00:42:59.836595 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:59.836563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vhcnk" podUID="ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d" Jul 18 00:42:59.978395 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:42:59.978349 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:43:00.608316 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:00.608283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:43:00.608316 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:00.608309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:43:00.608543 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:00.608283 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:43:04.747546 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:04.747503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:43:04.747546 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:04.747552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:04.747582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747669 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747694 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747750 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert podName:7811bca7-53b7-455a-8a24-ac1f41c9d47c nodeName:}" failed. No retries permitted until 2026-07-18 00:45:06.747733687 +0000 UTC m=+285.282616651 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v2jfq" (UID: "7811bca7-53b7-455a-8a24-ac1f41c9d47c") : secret "networking-console-plugin-cert" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747670 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747768 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls podName:ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d nodeName:}" failed. No retries permitted until 2026-07-18 00:45:06.747759146 +0000 UTC m=+285.282642110 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls") pod "dns-default-vhcnk" (UID: "ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d") : secret "dns-default-metrics-tls" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747778 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6477947558-8vs46: secret "image-registry-tls" not found Jul 18 00:43:04.748102 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:43:04.747825 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls podName:28fbc0b4-f843-4899-a073-4efa6f9abde2 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:06.747812065 +0000 UTC m=+285.282695029 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls") pod "image-registry-6477947558-8vs46" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2") : secret "image-registry-tls" not found Jul 18 00:43:13.959893 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:43:13.959804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:44:17.667736 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.667700 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f"] Jul 18 00:44:17.669775 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.669753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" Jul 18 00:44:17.670774 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.670747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf"] Jul 18 00:44:17.672466 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.672432 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wrnn9\"" Jul 18 00:44:17.672608 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.672432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:44:17.673612 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.673586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" Jul 18 00:44:17.673738 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.673675 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 18 00:44:17.675744 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.675722 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5krs"] Jul 18 00:44:17.676197 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.676181 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fchq2\"" Jul 18 00:44:17.677961 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.677943 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n2ttf"] Jul 18 00:44:17.678080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.678059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.680216 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.680193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.681388 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.681367 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 00:44:17.681805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.681769 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 00:44:17.681805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.681778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rsg94\"" Jul 18 00:44:17.681917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.681823 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 18 00:44:17.682295 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.682276 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 18 00:44:17.683217 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.683187 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:44:17.683338 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.683217 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-45jgq\"" Jul 18 00:44:17.684598 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.684423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 18 00:44:17.684598 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.684425 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 18 00:44:17.684800 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.684622 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 18 00:44:17.687604 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.687578 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f"] Jul 18 00:44:17.688834 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.688803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 18 00:44:17.690502 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.690288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf"] Jul 18 00:44:17.697574 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.697541 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n2ttf"] Jul 18 00:44:17.699235 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.699200 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 18 00:44:17.699768 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.699737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5krs"] Jul 18 00:44:17.764684 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-trusted-ca\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.764684 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd59p\" (UniqueName: \"kubernetes.io/projected/83cee856-e824-4f02-9537-e16892f2ecfa-kube-api-access-cd59p\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.764901 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764742 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.764901 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88bb9703-f81d-4a45-923f-f5829f881497-serving-cert\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.764901 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kml5g\" (UniqueName: \"kubernetes.io/projected/b9cc6033-217d-46ae-b9fc-ac4125507bad-kube-api-access-kml5g\") pod \"network-check-source-7bc5b6bf85-nrqtf\" (UID: \"b9cc6033-217d-46ae-b9fc-ac4125507bad\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" Jul 18 00:44:17.765007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smt28\" (UniqueName: \"kubernetes.io/projected/88bb9703-f81d-4a45-923f-f5829f881497-kube-api-access-smt28\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.765007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.764980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-snapshots\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.765080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.765031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.765080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.765055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-tmp\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.765150 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.765079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83cee856-e824-4f02-9537-e16892f2ecfa-serving-cert\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.765210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.765144 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-867z7\" (UniqueName: \"kubernetes.io/projected/07e66ac7-bace-49c3-a127-f0e964254842-kube-api-access-867z7\") pod \"volume-data-source-validator-78cf4c6f6-9wz6f\" (UID: \"07e66ac7-bace-49c3-a127-f0e964254842\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" Jul 18 00:44:17.765210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.765172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-config\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.766391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.766362 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7"] Jul 18 00:44:17.768379 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.768358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.770880 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.770861 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 18 00:44:17.771024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.770901 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 18 00:44:17.771088 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.771059 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:44:17.771088 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.771083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-srkkz\"" Jul 18 00:44:17.771221 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.771206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 18 00:44:17.779614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.779586 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7"] Jul 18 00:44:17.865949 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.865914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88bb9703-f81d-4a45-923f-f5829f881497-serving-cert\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.865949 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.865954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7aec31-fb16-4653-831f-edef4475b658-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.865978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kml5g\" (UniqueName: \"kubernetes.io/projected/b9cc6033-217d-46ae-b9fc-ac4125507bad-kube-api-access-kml5g\") pod \"network-check-source-7bc5b6bf85-nrqtf\" (UID: \"b9cc6033-217d-46ae-b9fc-ac4125507bad\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.865994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpx6\" (UniqueName: \"kubernetes.io/projected/7c7aec31-fb16-4653-831f-edef4475b658-kube-api-access-nqpx6\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smt28\" (UniqueName: \"kubernetes.io/projected/88bb9703-f81d-4a45-923f-f5829f881497-kube-api-access-smt28\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866038 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-snapshots\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866130 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-tmp\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83cee856-e824-4f02-9537-e16892f2ecfa-serving-cert\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.866228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-867z7\" (UniqueName: \"kubernetes.io/projected/07e66ac7-bace-49c3-a127-f0e964254842-kube-api-access-867z7\") pod \"volume-data-source-validator-78cf4c6f6-9wz6f\" (UID: \"07e66ac7-bace-49c3-a127-f0e964254842\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" Jul 18 00:44:17.866643 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-config\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.866643 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-trusted-ca\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.866643 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd59p\" (UniqueName: \"kubernetes.io/projected/83cee856-e824-4f02-9537-e16892f2ecfa-kube-api-access-cd59p\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.866643 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c7aec31-fb16-4653-831f-edef4475b658-config\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.866839 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.866896 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.866846 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-snapshots\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.867208 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.867180 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88bb9703-f81d-4a45-923f-f5829f881497-tmp\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.867208 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.867197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-service-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.867389 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.867270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88bb9703-f81d-4a45-923f-f5829f881497-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.867389 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.867304 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-config\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.867465 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.867385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/83cee856-e824-4f02-9537-e16892f2ecfa-trusted-ca\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.868659 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.868641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/88bb9703-f81d-4a45-923f-f5829f881497-serving-cert\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.868883 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.868861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83cee856-e824-4f02-9537-e16892f2ecfa-serving-cert\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.876014 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.875980 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd59p\" (UniqueName: \"kubernetes.io/projected/83cee856-e824-4f02-9537-e16892f2ecfa-kube-api-access-cd59p\") pod \"console-operator-565b7b569d-n2ttf\" (UID: \"83cee856-e824-4f02-9537-e16892f2ecfa\") " pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:17.876227 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.876203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smt28\" (UniqueName: \"kubernetes.io/projected/88bb9703-f81d-4a45-923f-f5829f881497-kube-api-access-smt28\") pod \"insights-operator-555d9d7885-v5krs\" (UID: \"88bb9703-f81d-4a45-923f-f5829f881497\") " pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:17.876319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.876297 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-867z7\" (UniqueName: \"kubernetes.io/projected/07e66ac7-bace-49c3-a127-f0e964254842-kube-api-access-867z7\") pod \"volume-data-source-validator-78cf4c6f6-9wz6f\" (UID: \"07e66ac7-bace-49c3-a127-f0e964254842\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" Jul 18 00:44:17.876354 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.876333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kml5g\" (UniqueName: \"kubernetes.io/projected/b9cc6033-217d-46ae-b9fc-ac4125507bad-kube-api-access-kml5g\") pod \"network-check-source-7bc5b6bf85-nrqtf\" (UID: \"b9cc6033-217d-46ae-b9fc-ac4125507bad\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" Jul 18 00:44:17.967327 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.967231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c7aec31-fb16-4653-831f-edef4475b658-config\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.967327 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.967296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7aec31-fb16-4653-831f-edef4475b658-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.967549 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.967418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpx6\" (UniqueName: \"kubernetes.io/projected/7c7aec31-fb16-4653-831f-edef4475b658-kube-api-access-nqpx6\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.967909 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.967891 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c7aec31-fb16-4653-831f-edef4475b658-config\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.969614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.969598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7c7aec31-fb16-4653-831f-edef4475b658-serving-cert\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.974841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.974815 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpx6\" (UniqueName: \"kubernetes.io/projected/7c7aec31-fb16-4653-831f-edef4475b658-kube-api-access-nqpx6\") pod \"service-ca-operator-5bcbc94c78-dh7z7\" (UID: \"7c7aec31-fb16-4653-831f-edef4475b658\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:17.980658 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.980634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" Jul 18 00:44:17.989186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:17.989156 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" Jul 18 00:44:18.001014 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.000987 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-v5krs" Jul 18 00:44:18.006210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.006176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:18.079336 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.079111 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" Jul 18 00:44:18.142849 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.142812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f"] Jul 18 00:44:18.146053 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:18.146015 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e66ac7_bace_49c3_a127_f0e964254842.slice/crio-fdd9866e3fb0d95b377195c21522911e8bf68cf8c8ad5f25b6af096937291ec7 WatchSource:0}: Error finding container fdd9866e3fb0d95b377195c21522911e8bf68cf8c8ad5f25b6af096937291ec7: Status 404 returned error can't find the container with id fdd9866e3fb0d95b377195c21522911e8bf68cf8c8ad5f25b6af096937291ec7 Jul 18 00:44:18.174157 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.174121 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf"] Jul 18 00:44:18.177596 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:18.177554 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cc6033_217d_46ae_b9fc_ac4125507bad.slice/crio-73d6900cfbf2400b9143479c1417c7c7cf567cc7c4c500ee74cce58ae2739938 WatchSource:0}: Error finding container 73d6900cfbf2400b9143479c1417c7c7cf567cc7c4c500ee74cce58ae2739938: Status 404 returned error can't find the container with id 73d6900cfbf2400b9143479c1417c7c7cf567cc7c4c500ee74cce58ae2739938 Jul 18 00:44:18.189836 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.189238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-v5krs"] Jul 18 00:44:18.193631 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:18.193603 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bb9703_f81d_4a45_923f_f5829f881497.slice/crio-cf8efabd1968828b5e416e54cece62f461e5a5fb385c108bfac94607eb0ddef3 WatchSource:0}: Error finding container cf8efabd1968828b5e416e54cece62f461e5a5fb385c108bfac94607eb0ddef3: Status 404 returned error can't find the container with id cf8efabd1968828b5e416e54cece62f461e5a5fb385c108bfac94607eb0ddef3 Jul 18 00:44:18.207141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.207059 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-n2ttf"] Jul 18 00:44:18.215678 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:18.215633 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83cee856_e824_4f02_9537_e16892f2ecfa.slice/crio-03124025f204ccabbc307570fe09a94d2adf128224cba7c96423b8af08df3635 WatchSource:0}: Error finding container 03124025f204ccabbc307570fe09a94d2adf128224cba7c96423b8af08df3635: Status 404 returned error can't find the container with id 03124025f204ccabbc307570fe09a94d2adf128224cba7c96423b8af08df3635 Jul 18 00:44:18.241922 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.241893 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7"] Jul 18 00:44:18.245547 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:18.245518 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7aec31_fb16_4653_831f_edef4475b658.slice/crio-898fa5560b285b43746224bc8b9beffab7c3c863ea1b388f5a36cb8c47ad57eb WatchSource:0}: Error finding container 898fa5560b285b43746224bc8b9beffab7c3c863ea1b388f5a36cb8c47ad57eb: Status 404 returned error can't find the container with id 898fa5560b285b43746224bc8b9beffab7c3c863ea1b388f5a36cb8c47ad57eb Jul 18 00:44:18.793755 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.793689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" event={"ID":"b9cc6033-217d-46ae-b9fc-ac4125507bad","Type":"ContainerStarted","Data":"add4c0592ed1c019f191fa9012a7ea0e1c88fbb5f9038b5a2a3e56b77f31fb33"} Jul 18 00:44:18.793755 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.793748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" event={"ID":"b9cc6033-217d-46ae-b9fc-ac4125507bad","Type":"ContainerStarted","Data":"73d6900cfbf2400b9143479c1417c7c7cf567cc7c4c500ee74cce58ae2739938"} Jul 18 00:44:18.795303 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.795263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" event={"ID":"83cee856-e824-4f02-9537-e16892f2ecfa","Type":"ContainerStarted","Data":"03124025f204ccabbc307570fe09a94d2adf128224cba7c96423b8af08df3635"} Jul 18 00:44:18.796753 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.796720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" event={"ID":"07e66ac7-bace-49c3-a127-f0e964254842","Type":"ContainerStarted","Data":"fdd9866e3fb0d95b377195c21522911e8bf68cf8c8ad5f25b6af096937291ec7"} Jul 18 00:44:18.798600 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.798531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" event={"ID":"7c7aec31-fb16-4653-831f-edef4475b658","Type":"ContainerStarted","Data":"898fa5560b285b43746224bc8b9beffab7c3c863ea1b388f5a36cb8c47ad57eb"} Jul 18 00:44:18.800292 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.800236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5krs" event={"ID":"88bb9703-f81d-4a45-923f-f5829f881497","Type":"ContainerStarted","Data":"cf8efabd1968828b5e416e54cece62f461e5a5fb385c108bfac94607eb0ddef3"} Jul 18 00:44:18.808291 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:18.808231 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nrqtf" podStartSLOduration=1.808208466 podStartE2EDuration="1.808208466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:18.807867038 +0000 UTC m=+237.342750028" watchObservedRunningTime="2026-07-18 00:44:18.808208466 +0000 UTC m=+237.343091444" Jul 18 00:44:19.806526 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:19.806463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" event={"ID":"07e66ac7-bace-49c3-a127-f0e964254842","Type":"ContainerStarted","Data":"768eb9c11fbb16f73e47b1d61e81bb8b1c147011282b45e7eadce6fd4e49e963"} Jul 18 00:44:19.822049 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:19.821985 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9wz6f" podStartSLOduration=1.5218987959999999 podStartE2EDuration="2.821959808s" totalImagesPullingTime="1.300061012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:19.820098532 +0000 UTC m=+238.354981519" watchObservedRunningTime="2026-07-18 00:44:19.821959808 +0000 UTC m=+238.356842866" Jul 18 00:44:21.814545 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.814515 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/0.log" Jul 18 00:44:21.815009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.814560 2577 generic.go:356] "Generic (PLEG): container finished" podID="83cee856-e824-4f02-9537-e16892f2ecfa" containerID="7c9f74bbe02bfb12b366410a2daebc630ac7b3d308f3297d6c1db1e5388bcfcd" exitCode=255 Jul 18 00:44:21.815009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.814645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" event={"ID":"83cee856-e824-4f02-9537-e16892f2ecfa","Type":"ContainerDied","Data":"7c9f74bbe02bfb12b366410a2daebc630ac7b3d308f3297d6c1db1e5388bcfcd"} Jul 18 00:44:21.815009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.814920 2577 scope.go:117] "RemoveContainer" containerID="7c9f74bbe02bfb12b366410a2daebc630ac7b3d308f3297d6c1db1e5388bcfcd" Jul 18 00:44:21.816346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.816313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" event={"ID":"7c7aec31-fb16-4653-831f-edef4475b658","Type":"ContainerStarted","Data":"6c1b2ae27aa483aa8ae0eb21abdb6789a494721e2e3113466558624e46ffc8b4"} Jul 18 00:44:21.818266 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.818241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5krs" event={"ID":"88bb9703-f81d-4a45-923f-f5829f881497","Type":"ContainerStarted","Data":"672316ff716609a7c6593547d110ca798d783ed1b5259f405c7c8d783db6b09b"} Jul 18 00:44:21.844731 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.844682 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" podStartSLOduration=1.6879328139999998 podStartE2EDuration="4.844666306s" totalImagesPullingTime="3.156733492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:21.844136865 +0000 UTC m=+240.379019851" watchObservedRunningTime="2026-07-18 00:44:21.844666306 +0000 UTC m=+240.379549292" Jul 18 00:44:21.862519 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.861875 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-v5krs" podStartSLOduration=1.65860712 podStartE2EDuration="4.861858499s" totalImagesPullingTime="3.203251379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:21.860262815 +0000 UTC m=+240.395145809" watchObservedRunningTime="2026-07-18 00:44:21.861858499 +0000 UTC m=+240.396741519" Jul 18 00:44:21.995326 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.995253 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp"] Jul 18 00:44:21.997734 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:21.997715 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" Jul 18 00:44:22.000381 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.000340 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wt9tv\"" Jul 18 00:44:22.000607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.000414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 18 00:44:22.000664 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.000615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 18 00:44:22.007506 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.007453 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp"] Jul 18 00:44:22.113414 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.113308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/e28f1e21-f507-40a4-8726-67e06a674f81-kube-api-access-dclbw\") pod \"migrator-7cc9c7ffd7-d4flp\" (UID: \"e28f1e21-f507-40a4-8726-67e06a674f81\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" Jul 18 00:44:22.214914 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.214869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/e28f1e21-f507-40a4-8726-67e06a674f81-kube-api-access-dclbw\") pod \"migrator-7cc9c7ffd7-d4flp\" (UID: \"e28f1e21-f507-40a4-8726-67e06a674f81\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" Jul 18 00:44:22.222576 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.222551 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclbw\" (UniqueName: \"kubernetes.io/projected/e28f1e21-f507-40a4-8726-67e06a674f81-kube-api-access-dclbw\") pod \"migrator-7cc9c7ffd7-d4flp\" (UID: \"e28f1e21-f507-40a4-8726-67e06a674f81\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" Jul 18 00:44:22.328077 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.328039 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" Jul 18 00:44:22.464227 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.464040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp"] Jul 18 00:44:22.466591 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:22.466564 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28f1e21_f507_40a4_8726_67e06a674f81.slice/crio-ace54a2589fb6eeb8fc7245938cf104896ce748e4f086992b76cddbab9c8db15 WatchSource:0}: Error finding container ace54a2589fb6eeb8fc7245938cf104896ce748e4f086992b76cddbab9c8db15: Status 404 returned error can't find the container with id ace54a2589fb6eeb8fc7245938cf104896ce748e4f086992b76cddbab9c8db15 Jul 18 00:44:22.719067 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.718971 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d8rhv"] Jul 18 00:44:22.722586 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.722559 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.725444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.725408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 00:44:22.725627 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.725410 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 00:44:22.725627 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.725578 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56l9r\"" Jul 18 00:44:22.732128 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.732096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d8rhv"] Jul 18 00:44:22.820826 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.820795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2407c6a-3d22-4362-aacb-cced3e94b87f-crio-socket\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.821283 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.820839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.821283 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.820907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn4r7\" (UniqueName: \"kubernetes.io/projected/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-api-access-cn4r7\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.821283 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.820996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.821283 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.821024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2407c6a-3d22-4362-aacb-cced3e94b87f-data-volume\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.823177 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:44:22.823620 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823606 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/0.log" Jul 18 00:44:22.823698 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823640 2577 generic.go:356] "Generic (PLEG): container finished" podID="83cee856-e824-4f02-9537-e16892f2ecfa" containerID="34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042" exitCode=255 Jul 18 00:44:22.823734 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" event={"ID":"83cee856-e824-4f02-9537-e16892f2ecfa","Type":"ContainerDied","Data":"34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042"} Jul 18 00:44:22.823771 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823748 2577 scope.go:117] "RemoveContainer" containerID="7c9f74bbe02bfb12b366410a2daebc630ac7b3d308f3297d6c1db1e5388bcfcd" Jul 18 00:44:22.823983 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.823955 2577 scope.go:117] "RemoveContainer" containerID="34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042" Jul 18 00:44:22.824186 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:22.824161 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n2ttf_openshift-console-operator(83cee856-e824-4f02-9537-e16892f2ecfa)\"" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" podUID="83cee856-e824-4f02-9537-e16892f2ecfa" Jul 18 00:44:22.825035 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.825001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" event={"ID":"e28f1e21-f507-40a4-8726-67e06a674f81","Type":"ContainerStarted","Data":"ace54a2589fb6eeb8fc7245938cf104896ce748e4f086992b76cddbab9c8db15"} Jul 18 00:44:22.922362 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2407c6a-3d22-4362-aacb-cced3e94b87f-crio-socket\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922462 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a2407c6a-3d22-4362-aacb-cced3e94b87f-crio-socket\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922610 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:22.922546 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:22.922610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn4r7\" (UniqueName: \"kubernetes.io/projected/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-api-access-cn4r7\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922610 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:22.922613 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.422597979 +0000 UTC m=+241.957480991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : configmap "kube-rbac-proxy" not found Jul 18 00:44:22.922920 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922920 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.922811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2407c6a-3d22-4362-aacb-cced3e94b87f-data-volume\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.922920 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:22.922919 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:22.923069 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:22.922988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.422975468 +0000 UTC m=+241.957858432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:22.923178 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.923161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2407c6a-3d22-4362-aacb-cced3e94b87f-data-volume\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:22.933237 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:22.933205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn4r7\" (UniqueName: \"kubernetes.io/projected/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-api-access-cn4r7\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:23.428444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.428410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:23.428724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.428518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:23.428724 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:23.428539 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:23.428724 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:23.428608 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.428590267 +0000 UTC m=+242.963473231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : configmap "kube-rbac-proxy" not found Jul 18 00:44:23.428724 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:23.428613 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:23.428724 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:23.428658 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.428646604 +0000 UTC m=+242.963529569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:23.833089 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.833053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" event={"ID":"e28f1e21-f507-40a4-8726-67e06a674f81","Type":"ContainerStarted","Data":"baf1aec904adcbc8452450f7bd214ebd97f88fa8d0e227eee0ba829c2d63c371"} Jul 18 00:44:23.833530 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.833116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" event={"ID":"e28f1e21-f507-40a4-8726-67e06a674f81","Type":"ContainerStarted","Data":"2cd936016e193e5fcbff5743dbda53e6836bbc315267d5b9e6aa620ee82fab20"} Jul 18 00:44:23.834551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.834531 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:44:23.834823 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.834809 2577 scope.go:117] "RemoveContainer" containerID="34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042" Jul 18 00:44:23.834964 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:23.834947 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n2ttf_openshift-console-operator(83cee856-e824-4f02-9537-e16892f2ecfa)\"" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" podUID="83cee856-e824-4f02-9537-e16892f2ecfa" Jul 18 00:44:23.849086 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:23.849037 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-d4flp" podStartSLOduration=1.647383566 podStartE2EDuration="2.849018312s" totalImagesPullingTime="1.201634746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:23.848113655 +0000 UTC m=+242.382996640" watchObservedRunningTime="2026-07-18 00:44:23.849018312 +0000 UTC m=+242.383901298" Jul 18 00:44:24.435790 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:24.435753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:24.435992 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:24.435840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:24.435992 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:24.435883 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:24.435992 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:24.435941 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:24.435992 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:24.435951 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.435935333 +0000 UTC m=+244.970818297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : configmap "kube-rbac-proxy" not found Jul 18 00:44:24.435992 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:24.435980 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.435968888 +0000 UTC m=+244.970851852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:25.152498 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.152447 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w5d8l"] Jul 18 00:44:25.154468 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.154445 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.157351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.157326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 18 00:44:25.157475 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.157386 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 18 00:44:25.157475 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.157444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 18 00:44:25.157579 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.157534 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gn5mm\"" Jul 18 00:44:25.158410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.158394 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 18 00:44:25.161905 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.161881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w5d8l"] Jul 18 00:44:25.245900 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.242405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-cabundle\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.245900 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.242598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-key\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.245900 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.242640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hxz\" (UniqueName: \"kubernetes.io/projected/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-kube-api-access-b2hxz\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.343282 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.343232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hxz\" (UniqueName: \"kubernetes.io/projected/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-kube-api-access-b2hxz\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.343448 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.343323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-cabundle\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.343448 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.343391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-key\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.344016 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.343978 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-cabundle\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.345947 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.345923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-signing-key\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.351941 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.351912 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hxz\" (UniqueName: \"kubernetes.io/projected/6dd860c9-93db-4a3a-bbd7-6b80c4cd9027-kube-api-access-b2hxz\") pod \"service-ca-58598695f7-w5d8l\" (UID: \"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027\") " pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.463861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.463767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-w5d8l" Jul 18 00:44:25.595374 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.595341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-w5d8l"] Jul 18 00:44:25.598325 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:25.598294 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd860c9_93db_4a3a_bbd7_6b80c4cd9027.slice/crio-c49eec96bc917dbf1b53720918804e4786b3c33f6956dcb67a12db2c80a23845 WatchSource:0}: Error finding container c49eec96bc917dbf1b53720918804e4786b3c33f6956dcb67a12db2c80a23845: Status 404 returned error can't find the container with id c49eec96bc917dbf1b53720918804e4786b3c33f6956dcb67a12db2c80a23845 Jul 18 00:44:25.722518 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.722423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znnm9_d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5/dns-node-resolver/0.log" Jul 18 00:44:25.842975 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.842938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-w5d8l" event={"ID":"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027","Type":"ContainerStarted","Data":"5768acff97e10a16602812a3455e3f0727e4bccd4441d1fe4bc6215f2f122abf"} Jul 18 00:44:25.843173 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.842988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-w5d8l" event={"ID":"6dd860c9-93db-4a3a-bbd7-6b80c4cd9027","Type":"ContainerStarted","Data":"c49eec96bc917dbf1b53720918804e4786b3c33f6956dcb67a12db2c80a23845"} Jul 18 00:44:25.860869 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:25.860817 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-w5d8l" podStartSLOduration=0.860797954 podStartE2EDuration="860.797954ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:25.860395555 +0000 UTC m=+244.395278537" watchObservedRunningTime="2026-07-18 00:44:25.860797954 +0000 UTC m=+244.395680982" Jul 18 00:44:26.452968 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:26.452924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:26.453363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:26.453018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:26.453363 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:26.453058 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:26.453363 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:26.453107 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:26.453363 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:26.453141 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.45312203 +0000 UTC m=+248.988004994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : configmap "kube-rbac-proxy" not found Jul 18 00:44:26.453363 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:26.453157 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.453150625 +0000 UTC m=+248.988033589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:26.723154 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:26.723064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slv4q_123ca7fe-59f2-4012-88f1-a755b47e1ffb/node-ca/0.log" Jul 18 00:44:27.123158 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:27.123122 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btfk5_4d312b42-1264-40e8-95be-91339ee220a0/serve-healthcheck-canary/0.log" Jul 18 00:44:27.723116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:27.722987 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-d4flp_e28f1e21-f507-40a4-8726-67e06a674f81/migrator/0.log" Jul 18 00:44:27.921714 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:27.921684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-d4flp_e28f1e21-f507-40a4-8726-67e06a674f81/graceful-termination/0.log" Jul 18 00:44:28.007244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:28.007150 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:28.007244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:28.007208 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:28.007593 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:28.007579 2577 scope.go:117] "RemoveContainer" containerID="34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042" Jul 18 00:44:28.007746 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:28.007728 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-n2ttf_openshift-console-operator(83cee856-e824-4f02-9537-e16892f2ecfa)\"" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" podUID="83cee856-e824-4f02-9537-e16892f2ecfa" Jul 18 00:44:30.488540 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:30.488501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:30.488916 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:30.488572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:30.488916 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:30.488640 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:30.488916 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:30.488666 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:30.488916 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:30.488712 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.488696932 +0000 UTC m=+257.023579896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:30.488916 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:30.488723 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm podName:a2407c6a-3d22-4362-aacb-cced3e94b87f nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.488717506 +0000 UTC m=+257.023600470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d8rhv" (UID: "a2407c6a-3d22-4362-aacb-cced3e94b87f") : configmap "kube-rbac-proxy" not found Jul 18 00:44:33.716650 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:33.716608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:44:33.717034 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:33.716761 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 00:44:33.717034 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:33.716825 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs podName:753ad8ea-6811-45d6-9e4b-ae2041db9c5b nodeName:}" failed. No retries permitted until 2026-07-18 00:46:35.71680861 +0000 UTC m=+374.251691575 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs") pod "network-metrics-daemon-ggk8j" (UID: "753ad8ea-6811-45d6-9e4b-ae2041db9c5b") : secret "metrics-daemon-secret" not found Jul 18 00:44:38.556281 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.556235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:38.556730 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.556326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:38.556781 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.556763 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a2407c6a-3d22-4362-aacb-cced3e94b87f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:38.558752 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.558723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a2407c6a-3d22-4362-aacb-cced3e94b87f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d8rhv\" (UID: \"a2407c6a-3d22-4362-aacb-cced3e94b87f\") " pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:38.638051 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.638017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d8rhv" Jul 18 00:44:38.769683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.769658 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d8rhv"] Jul 18 00:44:38.772096 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:38.772071 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2407c6a_3d22_4362_aacb_cced3e94b87f.slice/crio-2bab0d12c0a0435ee6169c1106a614f8eb5e65105b477f6b16390091e262504b WatchSource:0}: Error finding container 2bab0d12c0a0435ee6169c1106a614f8eb5e65105b477f6b16390091e262504b: Status 404 returned error can't find the container with id 2bab0d12c0a0435ee6169c1106a614f8eb5e65105b477f6b16390091e262504b Jul 18 00:44:38.884616 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:38.884525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8rhv" event={"ID":"a2407c6a-3d22-4362-aacb-cced3e94b87f","Type":"ContainerStarted","Data":"2bab0d12c0a0435ee6169c1106a614f8eb5e65105b477f6b16390091e262504b"} Jul 18 00:44:41.961435 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:41.961348 2577 scope.go:117] "RemoveContainer" containerID="34522bfeee9dcf57d830c27ca0a51082607e300b782cd9355c187eb9bf07e042" Jul 18 00:44:43.903247 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:43.903222 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:44:43.903714 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:43.903329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" event={"ID":"83cee856-e824-4f02-9537-e16892f2ecfa","Type":"ContainerStarted","Data":"c71b713f454de6366f0143c004c7e6170e6773fabdbb5e5108772444c97bb855"} Jul 18 00:44:43.903714 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:43.903647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:43.905050 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:43.905009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8rhv" event={"ID":"a2407c6a-3d22-4362-aacb-cced3e94b87f","Type":"ContainerStarted","Data":"113347a290aa4ed7f579414f305c75332479aa0de3bb693836ce534d8b03b82f"} Jul 18 00:44:43.919662 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:43.919613 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" podStartSLOduration=23.732290888 podStartE2EDuration="26.91959889s" totalImagesPullingTime="3.187308002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:43.919239524 +0000 UTC m=+262.454122510" watchObservedRunningTime="2026-07-18 00:44:43.91959889 +0000 UTC m=+262.454481876" Jul 18 00:44:44.705499 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:44.705448 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-n2ttf" Jul 18 00:44:45.553141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.553105 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-dj9rd"] Jul 18 00:44:45.564992 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.564945 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:44:45.567974 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.567941 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-d544h\"" Jul 18 00:44:45.568144 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.567988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 00:44:45.568144 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.567941 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 00:44:45.571952 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.571912 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dj9rd"] Jul 18 00:44:45.621572 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.621539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56n4f\" (UniqueName: \"kubernetes.io/projected/9743e3b0-ee06-4b26-9c3a-3e336c509589-kube-api-access-56n4f\") pod \"downloads-5bc67dcd46-dj9rd\" (UID: \"9743e3b0-ee06-4b26-9c3a-3e336c509589\") " pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:44:45.721979 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.721948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56n4f\" (UniqueName: \"kubernetes.io/projected/9743e3b0-ee06-4b26-9c3a-3e336c509589-kube-api-access-56n4f\") pod \"downloads-5bc67dcd46-dj9rd\" (UID: \"9743e3b0-ee06-4b26-9c3a-3e336c509589\") " pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:44:45.732220 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.732183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56n4f\" (UniqueName: \"kubernetes.io/projected/9743e3b0-ee06-4b26-9c3a-3e336c509589-kube-api-access-56n4f\") pod \"downloads-5bc67dcd46-dj9rd\" (UID: \"9743e3b0-ee06-4b26-9c3a-3e336c509589\") " pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:44:45.877813 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:45.877765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:44:47.082833 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:47.082799 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-dj9rd"] Jul 18 00:44:47.085699 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:47.085670 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9743e3b0_ee06_4b26_9c3a_3e336c509589.slice/crio-adec3afbf886af298f22955aae043d72b2feb1461003b434e8644fae22017a28 WatchSource:0}: Error finding container adec3afbf886af298f22955aae043d72b2feb1461003b434e8644fae22017a28: Status 404 returned error can't find the container with id adec3afbf886af298f22955aae043d72b2feb1461003b434e8644fae22017a28 Jul 18 00:44:47.922245 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:47.922212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dj9rd" event={"ID":"9743e3b0-ee06-4b26-9c3a-3e336c509589","Type":"ContainerStarted","Data":"adec3afbf886af298f22955aae043d72b2feb1461003b434e8644fae22017a28"} Jul 18 00:44:47.924917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:47.924845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8rhv" event={"ID":"a2407c6a-3d22-4362-aacb-cced3e94b87f","Type":"ContainerStarted","Data":"1c5d9ad9d694dccaf628c1328a8199c9e17151f96d7f5bea1ffa2b07c2b45949"} Jul 18 00:44:51.942889 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:51.942846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d8rhv" event={"ID":"a2407c6a-3d22-4362-aacb-cced3e94b87f","Type":"ContainerStarted","Data":"5ead92030c214605f4cd93db8d0653d71dcfb1049502722312f0afecce919075"} Jul 18 00:44:51.960377 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:51.960310 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d8rhv" podStartSLOduration=17.971712292 podStartE2EDuration="29.960288437s" totalImagesPullingTime="11.988576145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:44:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:51.958103726 +0000 UTC m=+270.492986723" watchObservedRunningTime="2026-07-18 00:44:51.960288437 +0000 UTC m=+270.495171425" Jul 18 00:44:53.233327 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.233284 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r"] Jul 18 00:44:53.236757 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.236732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:53.240346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.240318 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6djqb\"" Jul 18 00:44:53.240621 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.240603 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 18 00:44:53.254171 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.254132 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r"] Jul 18 00:44:53.393381 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.393342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h2r8r\" (UID: \"24442f34-21be-4afd-8e8b-54895e8db643\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:53.493934 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.493839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h2r8r\" (UID: \"24442f34-21be-4afd-8e8b-54895e8db643\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:53.494088 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:53.494027 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 18 00:44:53.494154 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:53.494112 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates podName:24442f34-21be-4afd-8e8b-54895e8db643 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:53.994095058 +0000 UTC m=+272.528978023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-h2r8r" (UID: "24442f34-21be-4afd-8e8b-54895e8db643") : secret "prometheus-operator-admission-webhook-tls" not found Jul 18 00:44:53.998431 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:53.998388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h2r8r\" (UID: \"24442f34-21be-4afd-8e8b-54895e8db643\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:54.001225 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:54.001191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24442f34-21be-4afd-8e8b-54895e8db643-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h2r8r\" (UID: \"24442f34-21be-4afd-8e8b-54895e8db643\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:54.150185 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:54.150132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:54.299837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:54.299687 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r"] Jul 18 00:44:54.302700 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:54.302664 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24442f34_21be_4afd_8e8b_54895e8db643.slice/crio-d0490b2636814e94d2b52f3e7bfbae498e8f0ec802b62a177f6fc0d9761da505 WatchSource:0}: Error finding container d0490b2636814e94d2b52f3e7bfbae498e8f0ec802b62a177f6fc0d9761da505: Status 404 returned error can't find the container with id d0490b2636814e94d2b52f3e7bfbae498e8f0ec802b62a177f6fc0d9761da505 Jul 18 00:44:54.956233 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:54.956188 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" event={"ID":"24442f34-21be-4afd-8e8b-54895e8db643","Type":"ContainerStarted","Data":"d0490b2636814e94d2b52f3e7bfbae498e8f0ec802b62a177f6fc0d9761da505"} Jul 18 00:44:55.190644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.190611 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:44:55.214046 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.213951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:44:55.214209 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.214123 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.217110 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.217032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 00:44:55.217110 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.217079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 00:44:55.217110 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.217100 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7fbvj\"" Jul 18 00:44:55.217364 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.217089 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 00:44:55.218359 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.218333 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 00:44:55.218515 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.218401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 00:44:55.223739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.223350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 00:44:55.309846 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.309815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.309846 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.309857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.310346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.309952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.310346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.310022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.310346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.310052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.310346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.310097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwz6q\" (UniqueName: \"kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.310346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.310161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411011 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.410978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411401 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.411401 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.411254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwz6q\" (UniqueName: \"kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.412400 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.412314 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.412400 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.412358 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.412400 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.412391 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.412667 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.412549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.414653 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.414629 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.414935 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.414918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.423446 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.423416 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwz6q\" (UniqueName: \"kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q\") pod \"console-8575f946b8-xngww\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.526939 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.526853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:44:55.697019 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.696984 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:44:55.820961 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:44:55.820926 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd33662_63bf_44c3_b93c_8dd69c52addd.slice/crio-58eec19ae169793e860b709eda23f40d75afd56189072e400b8553c35148f494 WatchSource:0}: Error finding container 58eec19ae169793e860b709eda23f40d75afd56189072e400b8553c35148f494: Status 404 returned error can't find the container with id 58eec19ae169793e860b709eda23f40d75afd56189072e400b8553c35148f494 Jul 18 00:44:55.968092 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.968038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8575f946b8-xngww" event={"ID":"1dd33662-63bf-44c3-b93c-8dd69c52addd","Type":"ContainerStarted","Data":"58eec19ae169793e860b709eda23f40d75afd56189072e400b8553c35148f494"} Jul 18 00:44:55.968276 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.968100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" event={"ID":"24442f34-21be-4afd-8e8b-54895e8db643","Type":"ContainerStarted","Data":"e4199d829e8b47ccd7f4a9419e52b026d31de98bf2971b4e969c140709aaf98f"} Jul 18 00:44:55.968357 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.968342 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:55.969912 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.969870 2577 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-85574b5f49-h2r8r container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.19:8443/healthz\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jul 18 00:44:55.970069 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.969921 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" podUID="24442f34-21be-4afd-8e8b-54895e8db643" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.19:8443/healthz\": dial tcp 10.132.0.19:8443: connect: connection refused" Jul 18 00:44:55.984131 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:55.984072 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" podStartSLOduration=1.4401144289999999 podStartE2EDuration="2.984045375s" totalImagesPullingTime="1.543930946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:55.983290689 +0000 UTC m=+274.518173676" watchObservedRunningTime="2026-07-18 00:44:55.984045375 +0000 UTC m=+274.518928360" Jul 18 00:44:56.978257 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:56.978222 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h2r8r" Jul 18 00:44:57.266069 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.265982 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-d7zws"] Jul 18 00:44:57.269819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.269789 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.272761 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.272836 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.272900 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.272911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.273047 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wrtb2\"" Jul 18 00:44:57.273187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.273112 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 18 00:44:57.279765 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.279690 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-d7zws"] Jul 18 00:44:57.431190 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.431148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.431387 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.431205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7cc6\" (UniqueName: \"kubernetes.io/projected/3aa43206-9ab1-498e-919c-db65a8e8a45c-kube-api-access-j7cc6\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.431387 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.431362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.431528 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.431404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa43206-9ab1-498e-919c-db65a8e8a45c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.532717 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.532623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7cc6\" (UniqueName: \"kubernetes.io/projected/3aa43206-9ab1-498e-919c-db65a8e8a45c-kube-api-access-j7cc6\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.532887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.532761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.532887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.532790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa43206-9ab1-498e-919c-db65a8e8a45c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.532887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.532862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.533039 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:57.532964 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 18 00:44:57.533039 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:44:57.533021 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls podName:3aa43206-9ab1-498e-919c-db65a8e8a45c nodeName:}" failed. No retries permitted until 2026-07-18 00:44:58.033003665 +0000 UTC m=+276.567886631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-d7zws" (UID: "3aa43206-9ab1-498e-919c-db65a8e8a45c") : secret "prometheus-operator-tls" not found Jul 18 00:44:57.533622 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.533593 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa43206-9ab1-498e-919c-db65a8e8a45c-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.535848 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.535822 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:57.541896 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:57.541859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7cc6\" (UniqueName: \"kubernetes.io/projected/3aa43206-9ab1-498e-919c-db65a8e8a45c-kube-api-access-j7cc6\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:58.037331 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:58.037286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:58.040048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:58.040019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3aa43206-9ab1-498e-919c-db65a8e8a45c-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-d7zws\" (UID: \"3aa43206-9ab1-498e-919c-db65a8e8a45c\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:44:58.183107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:44:58.183069 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" Jul 18 00:45:03.609353 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:03.609295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6477947558-8vs46" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" Jul 18 00:45:03.609353 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:03.609295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" podUID="7811bca7-53b7-455a-8a24-ac1f41c9d47c" Jul 18 00:45:03.609869 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:03.609295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vhcnk" podUID="ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d" Jul 18 00:45:03.999373 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:03.999287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:03.999373 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:03.999298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:03.999618 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:03.999441 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:45:05.219791 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:05.219763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-d7zws"] Jul 18 00:45:05.222673 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:45:05.222639 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa43206_9ab1_498e_919c_db65a8e8a45c.slice/crio-633b6a3ea43b9798e65c7b5e80ac0eeba226b6c2fe1863b93a15550b1d6fb22a WatchSource:0}: Error finding container 633b6a3ea43b9798e65c7b5e80ac0eeba226b6c2fe1863b93a15550b1d6fb22a: Status 404 returned error can't find the container with id 633b6a3ea43b9798e65c7b5e80ac0eeba226b6c2fe1863b93a15550b1d6fb22a Jul 18 00:45:06.011525 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.010123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-dj9rd" event={"ID":"9743e3b0-ee06-4b26-9c3a-3e336c509589","Type":"ContainerStarted","Data":"66ee86ca1f2a52b5f3983b29d597d7a74df64b5189abdcd1c3ad4284fae63b1e"} Jul 18 00:45:06.012108 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.012033 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:45:06.013955 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.013903 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" event={"ID":"3aa43206-9ab1-498e-919c-db65a8e8a45c","Type":"ContainerStarted","Data":"633b6a3ea43b9798e65c7b5e80ac0eeba226b6c2fe1863b93a15550b1d6fb22a"} Jul 18 00:45:06.015629 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.015599 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8575f946b8-xngww" event={"ID":"1dd33662-63bf-44c3-b93c-8dd69c52addd","Type":"ContainerStarted","Data":"c223d84dd36dfe9b09436d3b6831a5385d89dbcacc23af420c9b52ba6ec21b9a"} Jul 18 00:45:06.026609 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.026518 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-dj9rd" Jul 18 00:45:06.028692 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.028627 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-dj9rd" podStartSLOduration=3.00946169 podStartE2EDuration="21.028606347s" totalImagesPullingTime="18.019144657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:06.026255612 +0000 UTC m=+284.561138609" watchObservedRunningTime="2026-07-18 00:45:06.028606347 +0000 UTC m=+284.563489334" Jul 18 00:45:06.042538 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.042300 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8575f946b8-xngww" podStartSLOduration=1.792277347 podStartE2EDuration="11.042282485s" totalImagesPullingTime="9.250005138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:06.041752831 +0000 UTC m=+284.576635820" watchObservedRunningTime="2026-07-18 00:45:06.042282485 +0000 UTC m=+284.577165472" Jul 18 00:45:06.819209 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.819155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:45:06.819209 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.819212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:06.819768 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.819282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:06.822294 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.822239 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7811bca7-53b7-455a-8a24-ac1f41c9d47c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v2jfq\" (UID: \"7811bca7-53b7-455a-8a24-ac1f41c9d47c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:45:06.822454 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.822390 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"image-registry-6477947558-8vs46\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:06.822553 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:06.822472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d-metrics-tls\") pod \"dns-default-vhcnk\" (UID: \"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d\") " pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:07.004133 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.004102 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lrgc9\"" Jul 18 00:45:07.004300 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.004168 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\"" Jul 18 00:45:07.004300 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.004171 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9q97z\"" Jul 18 00:45:07.010759 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.010727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:07.010759 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.010761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:07.010952 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.010762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" Jul 18 00:45:07.219167 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.217716 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vhcnk"] Jul 18 00:45:07.221773 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:45:07.221724 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0cfea2_159b_4b2d_b96c_c905bd4fbd4d.slice/crio-1610031c4c341d22e6af67806ed46c4c9ad1d0207f0efadb2953143c9009811c WatchSource:0}: Error finding container 1610031c4c341d22e6af67806ed46c4c9ad1d0207f0efadb2953143c9009811c: Status 404 returned error can't find the container with id 1610031c4c341d22e6af67806ed46c4c9ad1d0207f0efadb2953143c9009811c Jul 18 00:45:07.283577 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.283500 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:45:07.288820 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:45:07.288773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28fbc0b4_f843_4899_a073_4efa6f9abde2.slice/crio-288196bfda290d8b50a4af71ab0dff592a486ff517acd924811aefeb15408154 WatchSource:0}: Error finding container 288196bfda290d8b50a4af71ab0dff592a486ff517acd924811aefeb15408154: Status 404 returned error can't find the container with id 288196bfda290d8b50a4af71ab0dff592a486ff517acd924811aefeb15408154 Jul 18 00:45:07.320428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:07.320396 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq"] Jul 18 00:45:08.025559 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.025518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhcnk" event={"ID":"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d","Type":"ContainerStarted","Data":"1610031c4c341d22e6af67806ed46c4c9ad1d0207f0efadb2953143c9009811c"} Jul 18 00:45:08.028940 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.028907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" event={"ID":"3aa43206-9ab1-498e-919c-db65a8e8a45c","Type":"ContainerStarted","Data":"d560b83020a090efcafc34fbc360ac372f825c23db4abd35da747a3c94333217"} Jul 18 00:45:08.029096 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.028952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" event={"ID":"3aa43206-9ab1-498e-919c-db65a8e8a45c","Type":"ContainerStarted","Data":"c5cf988d9569db61186464ec962724160a551489851e0d28450999e56a5cbcb8"} Jul 18 00:45:08.030816 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.030784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" event={"ID":"7811bca7-53b7-455a-8a24-ac1f41c9d47c","Type":"ContainerStarted","Data":"0c94b8a86a55ef895d5c6bad6c4338ea542852471ca5e27113df6d0b5a642a2c"} Jul 18 00:45:08.032938 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.032845 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6477947558-8vs46" event={"ID":"28fbc0b4-f843-4899-a073-4efa6f9abde2","Type":"ContainerStarted","Data":"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c"} Jul 18 00:45:08.032938 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.032894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6477947558-8vs46" event={"ID":"28fbc0b4-f843-4899-a073-4efa6f9abde2","Type":"ContainerStarted","Data":"288196bfda290d8b50a4af71ab0dff592a486ff517acd924811aefeb15408154"} Jul 18 00:45:08.033336 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.033316 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:08.050768 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.047538 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-d7zws" podStartSLOduration=9.275631569 podStartE2EDuration="11.047513298s" totalImagesPullingTime="1.771881729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:08.046522084 +0000 UTC m=+286.581405071" watchObservedRunningTime="2026-07-18 00:45:08.047513298 +0000 UTC m=+286.582396285" Jul 18 00:45:08.072641 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:08.072579 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6477947558-8vs46" podStartSLOduration=285.072553693 podStartE2EDuration="4m45.072553693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:08.070993499 +0000 UTC m=+286.605876478" watchObservedRunningTime="2026-07-18 00:45:08.072553693 +0000 UTC m=+286.607436682" Jul 18 00:45:09.625218 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.623612 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pmknx"] Jul 18 00:45:09.663825 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.663794 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lrjsl"] Jul 18 00:45:09.666085 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.664141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.673043 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.670843 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nd82c\"" Jul 18 00:45:09.673043 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.671097 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 18 00:45:09.680683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.673679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 18 00:45:09.683422 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.681226 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 18 00:45:09.712505 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.710111 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pmknx"] Jul 18 00:45:09.712505 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.710273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.716497 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.713795 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 00:45:09.716497 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.714027 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q86qg\"" Jul 18 00:45:09.716497 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.714245 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 00:45:09.716497 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.714396 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 00:45:09.760316 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.760585 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-sys\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.760696 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.760786 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.760880 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-metrics-client-ca\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.760978 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.760964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.761069 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761057 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-wtmp\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.761159 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.761259 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65e9145-3e90-498a-9e42-b7d57845eee4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.761361 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wm8v\" (UniqueName: \"kubernetes.io/projected/3c5d1b0c-780c-4338-a03d-2444e50813a2-kube-api-access-9wm8v\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.761477 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-textfile\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.761604 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9wr\" (UniqueName: \"kubernetes.io/projected/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-api-access-7v9wr\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.761682 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-root\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.761776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.761863 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.761851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.862906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wm8v\" (UniqueName: \"kubernetes.io/projected/3c5d1b0c-780c-4338-a03d-2444e50813a2-kube-api-access-9wm8v\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.862973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-textfile\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9wr\" (UniqueName: \"kubernetes.io/projected/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-api-access-7v9wr\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.863060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-root\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-sys\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-metrics-client-ca\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.863449 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.863256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.866084 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.866035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-wtmp\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.866244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.866089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.866244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.866133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65e9145-3e90-498a-9e42-b7d57845eee4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.866870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.866534 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-wtmp\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.866870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.866584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e65e9145-3e90-498a-9e42-b7d57845eee4-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.867620 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.867599 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-metrics-client-ca\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.867775 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.867655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.867935 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.867919 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-sys\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.868116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:09.868098 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 18 00:45:09.868264 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:09.868242 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 18 00:45:09.868370 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:09.868356 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls podName:3c5d1b0c-780c-4338-a03d-2444e50813a2 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:10.368245973 +0000 UTC m=+288.903128937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls") pod "node-exporter-lrjsl" (UID: "3c5d1b0c-780c-4338-a03d-2444e50813a2") : secret "node-exporter-tls" not found Jul 18 00:45:09.868474 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:09.868464 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls podName:e65e9145-3e90-498a-9e42-b7d57845eee4 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:10.368449523 +0000 UTC m=+288.903332495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-pmknx" (UID: "e65e9145-3e90-498a-9e42-b7d57845eee4") : secret "kube-state-metrics-tls" not found Jul 18 00:45:09.871529 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.868947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.871665 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.868951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.871770 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.868997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c5d1b0c-780c-4338-a03d-2444e50813a2-root\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.871884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.868424 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-textfile\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.880573 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.880448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.881952 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.881911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:09.884237 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.884197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9wr\" (UniqueName: \"kubernetes.io/projected/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-api-access-7v9wr\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:09.886776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:09.886716 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wm8v\" (UniqueName: \"kubernetes.io/projected/3c5d1b0c-780c-4338-a03d-2444e50813a2-kube-api-access-9wm8v\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:10.371416 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.371375 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:10.371594 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.371441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:10.374717 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.374689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c5d1b0c-780c-4338-a03d-2444e50813a2-node-exporter-tls\") pod \"node-exporter-lrjsl\" (UID: \"3c5d1b0c-780c-4338-a03d-2444e50813a2\") " pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:10.374717 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.374709 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65e9145-3e90-498a-9e42-b7d57845eee4-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-pmknx\" (UID: \"e65e9145-3e90-498a-9e42-b7d57845eee4\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:10.584448 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.584411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" Jul 18 00:45:10.627921 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.627884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lrjsl" Jul 18 00:45:10.677907 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.677875 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:45:10.718477 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.717083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:45:10.718477 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.717256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.720888 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.720735 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 00:45:10.721552 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721166 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 00:45:10.721552 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721463 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721689 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721958 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.722021 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.721959 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.722266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cdkk9\"" Jul 18 00:45:10.723444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.722580 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 00:45:10.776159 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswdm\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776635 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776635 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776466 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776635 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776562 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776635 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.776822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.776803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.789565 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.789532 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-pmknx"] Jul 18 00:45:10.793207 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:45:10.793171 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65e9145_3e90_498a_9e42_b7d57845eee4.slice/crio-eda2c28a5fb244840ffa5ec8c51707a59ddad41eca947e94fc6d9ace7aecfeaa WatchSource:0}: Error finding container eda2c28a5fb244840ffa5ec8c51707a59ddad41eca947e94fc6d9ace7aecfeaa: Status 404 returned error can't find the container with id eda2c28a5fb244840ffa5ec8c51707a59ddad41eca947e94fc6d9ace7aecfeaa Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877918 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dswdm\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877941 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.877999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.878027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.878064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.878429 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.878094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.879116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.878517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.879116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:10.878707 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 18 00:45:10.879116 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:10.878797 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls podName:b3182ed9-b635-413a-830d-b576d9b21e9b nodeName:}" failed. No retries permitted until 2026-07-18 00:45:11.378772706 +0000 UTC m=+289.913655683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b") : secret "alertmanager-main-tls" not found Jul 18 00:45:10.879519 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.879319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.881100 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.881037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.881204 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:10.881154 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle podName:b3182ed9-b635-413a-830d-b576d9b21e9b nodeName:}" failed. No retries permitted until 2026-07-18 00:45:11.381136955 +0000 UTC m=+289.916019922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b") : configmap references non-existent config key: ca-bundle.crt Jul 18 00:45:10.881518 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.881498 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.885921 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.885861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.886389 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.886343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.886591 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.886549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.886675 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.886627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.887042 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.887021 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.888994 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.888969 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.891185 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.890902 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:10.891185 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:10.891134 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswdm\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:11.048335 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.048013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" event={"ID":"e65e9145-3e90-498a-9e42-b7d57845eee4","Type":"ContainerStarted","Data":"eda2c28a5fb244840ffa5ec8c51707a59ddad41eca947e94fc6d9ace7aecfeaa"} Jul 18 00:45:11.050203 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.050167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhcnk" event={"ID":"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d","Type":"ContainerStarted","Data":"110f52ab29d07d717a1650511687b63b47905ca4574aa74732bba5c4b668038c"} Jul 18 00:45:11.050334 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.050222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vhcnk" event={"ID":"ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d","Type":"ContainerStarted","Data":"1f2bcb8d55f4d8986f4d92d39d1c950235b62179266275e915020f25f04e819c"} Jul 18 00:45:11.051114 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.051090 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:11.053090 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.053061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" event={"ID":"7811bca7-53b7-455a-8a24-ac1f41c9d47c","Type":"ContainerStarted","Data":"9a87d8ef91499d38c9888dbc80f89ea726e725d83b9a16e9c21731bea070fe2c"} Jul 18 00:45:11.054579 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.054552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrjsl" event={"ID":"3c5d1b0c-780c-4338-a03d-2444e50813a2","Type":"ContainerStarted","Data":"09cf4b13b8554eb83ba346362f9ebec116855b93cf32401fa941ec2e630f8e2f"} Jul 18 00:45:11.067239 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.067167 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vhcnk" podStartSLOduration=252.097327955 podStartE2EDuration="4m15.067149531s" totalImagesPullingTime="2.969821576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:11.065770093 +0000 UTC m=+289.600653084" watchObservedRunningTime="2026-07-18 00:45:11.067149531 +0000 UTC m=+289.602032576" Jul 18 00:45:11.080920 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.080862 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v2jfq" podStartSLOduration=284.219744504 podStartE2EDuration="4m47.080841994s" totalImagesPullingTime="2.86109749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:11.079932534 +0000 UTC m=+289.614815524" watchObservedRunningTime="2026-07-18 00:45:11.080841994 +0000 UTC m=+289.615724979" Jul 18 00:45:11.385166 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.385101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:11.385166 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.385175 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:11.386986 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.386925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:11.388342 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.388305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:11.637005 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:11.636859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:45:12.094336 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:12.094300 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:45:12.200415 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:45:12.200337 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3182ed9_b635_413a_830d_b576d9b21e9b.slice/crio-bb2a89de561733b79591dc36bcc163e97e7b81ec27b8302a04b964e77c7f7b93 WatchSource:0}: Error finding container bb2a89de561733b79591dc36bcc163e97e7b81ec27b8302a04b964e77c7f7b93: Status 404 returned error can't find the container with id bb2a89de561733b79591dc36bcc163e97e7b81ec27b8302a04b964e77c7f7b93 Jul 18 00:45:13.069787 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:13.068808 2577 generic.go:356] "Generic (PLEG): container finished" podID="3c5d1b0c-780c-4338-a03d-2444e50813a2" containerID="5af486da23f43b131de5aa435f3c11a41242aa50e447e8a2182073437deb938a" exitCode=0 Jul 18 00:45:13.069787 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:13.069294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrjsl" event={"ID":"3c5d1b0c-780c-4338-a03d-2444e50813a2","Type":"ContainerDied","Data":"5af486da23f43b131de5aa435f3c11a41242aa50e447e8a2182073437deb938a"} Jul 18 00:45:13.076220 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:13.076178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"bb2a89de561733b79591dc36bcc163e97e7b81ec27b8302a04b964e77c7f7b93"} Jul 18 00:45:13.079893 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:13.079852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" event={"ID":"e65e9145-3e90-498a-9e42-b7d57845eee4","Type":"ContainerStarted","Data":"9e3533af9f6959294272d4b323aaeb37836555409491944ff4091bcba7cd82c0"} Jul 18 00:45:14.085036 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.084998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrjsl" event={"ID":"3c5d1b0c-780c-4338-a03d-2444e50813a2","Type":"ContainerStarted","Data":"2e069c46ff4c8e5d2bc293482f2952fff1790f63ca3df9eb9280b46e8de805c9"} Jul 18 00:45:14.085714 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.085054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lrjsl" event={"ID":"3c5d1b0c-780c-4338-a03d-2444e50813a2","Type":"ContainerStarted","Data":"715be5200678889f3920f62fd6be6df330931caf0f6d18cd98bc32882c361ff5"} Jul 18 00:45:14.087311 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.087284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" event={"ID":"e65e9145-3e90-498a-9e42-b7d57845eee4","Type":"ContainerStarted","Data":"b2a993c48a36d9c25c8804c9bb6a4eaf1090901ee42b04ae82c3c8b91a48ade7"} Jul 18 00:45:14.087416 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.087338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" event={"ID":"e65e9145-3e90-498a-9e42-b7d57845eee4","Type":"ContainerStarted","Data":"c369b2e684c387e46f08c1506d3cc709a8444c9de17c7eec61a01a375be4349d"} Jul 18 00:45:14.104513 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.104448 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lrjsl" podStartSLOduration=2.995373508 podStartE2EDuration="5.104433502s" totalImagesPullingTime="2.006021732s" totalInitContainerRuntime="103.038262ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:14.102795328 +0000 UTC m=+292.637678336" watchObservedRunningTime="2026-07-18 00:45:14.104433502 +0000 UTC m=+292.639316488" Jul 18 00:45:14.119226 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:14.119171 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-pmknx" podStartSLOduration=2.967610392 podStartE2EDuration="5.11915539s" totalImagesPullingTime="2.151544998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:14.118620938 +0000 UTC m=+292.653503925" watchObservedRunningTime="2026-07-18 00:45:14.11915539 +0000 UTC m=+292.654038375" Jul 18 00:45:15.093669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.093629 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942" exitCode=0 Jul 18 00:45:15.094129 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.093721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942"} Jul 18 00:45:15.527344 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.527261 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:45:15.527344 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.527333 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:45:15.528777 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.528747 2577 patch_prober.go:28] interesting pod/console-8575f946b8-xngww container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jul 18 00:45:15.528904 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:15.528797 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8575f946b8-xngww" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jul 18 00:45:16.961197 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:45:16.961151 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ggk8j" podUID="753ad8ea-6811-45d6-9e4b-ae2041db9c5b" Jul 18 00:45:17.112808 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:17.112775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2"} Jul 18 00:45:18.120924 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:18.120887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1"} Jul 18 00:45:18.121405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:18.120958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475"} Jul 18 00:45:18.121405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:18.120984 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774"} Jul 18 00:45:18.121405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:18.121009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30"} Jul 18 00:45:19.128674 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:19.128581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerStarted","Data":"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7"} Jul 18 00:45:19.157074 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:19.157017 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.060298107 podStartE2EDuration="9.157000119s" totalImagesPullingTime="5.08056242s" totalInitContainerRuntime="16.139592ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:19.154847163 +0000 UTC m=+297.689730147" watchObservedRunningTime="2026-07-18 00:45:19.157000119 +0000 UTC m=+297.691883147" Jul 18 00:45:20.094665 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:20.094625 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:45:21.840813 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:21.840767 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:45:21.841620 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:21.841590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:45:21.852629 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:21.852606 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 00:45:22.082139 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:22.082111 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vhcnk" Jul 18 00:45:27.015243 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:27.015206 2577 patch_prober.go:28] interesting pod/image-registry-6477947558-8vs46 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 18 00:45:27.015711 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:27.015258 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6477947558-8vs46" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 00:45:29.041405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:29.041374 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:45:31.961533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:31.961479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:45:32.182853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:32.182763 2577 generic.go:356] "Generic (PLEG): container finished" podID="7c7aec31-fb16-4653-831f-edef4475b658" containerID="6c1b2ae27aa483aa8ae0eb21abdb6789a494721e2e3113466558624e46ffc8b4" exitCode=0 Jul 18 00:45:32.182853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:32.182831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" event={"ID":"7c7aec31-fb16-4653-831f-edef4475b658","Type":"ContainerDied","Data":"6c1b2ae27aa483aa8ae0eb21abdb6789a494721e2e3113466558624e46ffc8b4"} Jul 18 00:45:32.183147 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:32.183131 2577 scope.go:117] "RemoveContainer" containerID="6c1b2ae27aa483aa8ae0eb21abdb6789a494721e2e3113466558624e46ffc8b4" Jul 18 00:45:33.188563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:33.188527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-dh7z7" event={"ID":"7c7aec31-fb16-4653-831f-edef4475b658","Type":"ContainerStarted","Data":"b86e8fe58b1d6685808edb50d89e914739864d7fac09c2da1f82fcb5ef3232c7"} Jul 18 00:45:35.923887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:35.923853 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:45:37.206227 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:37.206190 2577 generic.go:356] "Generic (PLEG): container finished" podID="88bb9703-f81d-4a45-923f-f5829f881497" containerID="672316ff716609a7c6593547d110ca798d783ed1b5259f405c7c8d783db6b09b" exitCode=0 Jul 18 00:45:37.206719 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:37.206270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5krs" event={"ID":"88bb9703-f81d-4a45-923f-f5829f881497","Type":"ContainerDied","Data":"672316ff716609a7c6593547d110ca798d783ed1b5259f405c7c8d783db6b09b"} Jul 18 00:45:37.206807 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:37.206753 2577 scope.go:117] "RemoveContainer" containerID="672316ff716609a7c6593547d110ca798d783ed1b5259f405c7c8d783db6b09b" Jul 18 00:45:38.212583 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:38.212549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-v5krs" event={"ID":"88bb9703-f81d-4a45-923f-f5829f881497","Type":"ContainerStarted","Data":"12ad3c913cc2aa8205c7947ffb18eb402d45d1a2aab801d4a8bd1fd0c9e6b385"} Jul 18 00:45:38.370761 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:38.370736 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btfk5_4d312b42-1264-40e8-95be-91339ee220a0/serve-healthcheck-canary/0.log" Jul 18 00:45:45.117982 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.117920 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8575f946b8-xngww" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerName="console" containerID="cri-o://c223d84dd36dfe9b09436d3b6831a5385d89dbcacc23af420c9b52ba6ec21b9a" gracePeriod=15 Jul 18 00:45:45.241237 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.241199 2577 generic.go:356] "Generic (PLEG): container finished" podID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerID="c223d84dd36dfe9b09436d3b6831a5385d89dbcacc23af420c9b52ba6ec21b9a" exitCode=0 Jul 18 00:45:45.241397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.241270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8575f946b8-xngww" event={"ID":"1dd33662-63bf-44c3-b93c-8dd69c52addd","Type":"ContainerDied","Data":"c223d84dd36dfe9b09436d3b6831a5385d89dbcacc23af420c9b52ba6ec21b9a"} Jul 18 00:45:45.390806 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.390726 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:45:45.496849 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.496813 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.496886 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.496909 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwz6q\" (UniqueName: \"kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.496955 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.496983 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497015 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497040 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config\") pod \"1dd33662-63bf-44c3-b93c-8dd69c52addd\" (UID: \"1dd33662-63bf-44c3-b93c-8dd69c52addd\") " Jul 18 00:45:45.497352 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497333 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:45.497453 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497420 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:45.497618 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497593 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:45.497677 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.497598 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config" (OuterVolumeSpecName: "console-config") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:45.499539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.499505 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:45.499808 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.499781 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q" (OuterVolumeSpecName: "kube-api-access-cwz6q") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "kube-api-access-cwz6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:45:45.499917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.499779 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dd33662-63bf-44c3-b93c-8dd69c52addd" (UID: "1dd33662-63bf-44c3-b93c-8dd69c52addd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:45.598134 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598093 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-service-ca\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598134 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598127 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-oauth-serving-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598134 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598137 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwz6q\" (UniqueName: \"kubernetes.io/projected/1dd33662-63bf-44c3-b93c-8dd69c52addd-kube-api-access-cwz6q\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598134 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598146 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-trusted-ca-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598154 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-serving-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598162 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-oauth-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:45.598397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:45.598169 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dd33662-63bf-44c3-b93c-8dd69c52addd-console-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:45:46.246613 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:46.246528 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8575f946b8-xngww" Jul 18 00:45:46.246613 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:46.246531 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8575f946b8-xngww" event={"ID":"1dd33662-63bf-44c3-b93c-8dd69c52addd","Type":"ContainerDied","Data":"58eec19ae169793e860b709eda23f40d75afd56189072e400b8553c35148f494"} Jul 18 00:45:46.246613 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:46.246597 2577 scope.go:117] "RemoveContainer" containerID="c223d84dd36dfe9b09436d3b6831a5385d89dbcacc23af420c9b52ba6ec21b9a" Jul 18 00:45:46.270679 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:46.270647 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:45:46.279121 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:46.279095 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8575f946b8-xngww"] Jul 18 00:45:47.965128 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:45:47.965092 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" path="/var/lib/kubelet/pods/1dd33662-63bf-44c3-b93c-8dd69c52addd/volumes" Jul 18 00:46:00.944812 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:00.944747 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6477947558-8vs46" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerName="registry" containerID="cri-o://fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c" gracePeriod=30 Jul 18 00:46:01.196986 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.196924 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:46:01.313253 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.313219 2577 generic.go:356] "Generic (PLEG): container finished" podID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerID="fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c" exitCode=0 Jul 18 00:46:01.313422 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.313263 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6477947558-8vs46" Jul 18 00:46:01.313422 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.313294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6477947558-8vs46" event={"ID":"28fbc0b4-f843-4899-a073-4efa6f9abde2","Type":"ContainerDied","Data":"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c"} Jul 18 00:46:01.313422 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.313339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6477947558-8vs46" event={"ID":"28fbc0b4-f843-4899-a073-4efa6f9abde2","Type":"ContainerDied","Data":"288196bfda290d8b50a4af71ab0dff592a486ff517acd924811aefeb15408154"} Jul 18 00:46:01.313422 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.313362 2577 scope.go:117] "RemoveContainer" containerID="fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c" Jul 18 00:46:01.321431 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.321415 2577 scope.go:117] "RemoveContainer" containerID="fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c" Jul 18 00:46:01.321712 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:01.321694 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c\": container with ID starting with fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c not found: ID does not exist" containerID="fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c" Jul 18 00:46:01.321787 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.321721 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c"} err="failed to get container status \"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c\": rpc error: code = NotFound desc = could not find container \"fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c\": container with ID starting with fcc74daf804ecaa4cff9041be43540c394613d4bea53dda1b84b4b61bce0a45c not found: ID does not exist" Jul 18 00:46:01.349015 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.348978 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr5cl\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349015 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349022 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349061 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349095 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349129 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349144 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349158 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349219 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349180 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca\") pod \"28fbc0b4-f843-4899-a073-4efa6f9abde2\" (UID: \"28fbc0b4-f843-4899-a073-4efa6f9abde2\") " Jul 18 00:46:01.349754 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349702 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:46:01.349881 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.349755 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:46:01.351841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.351816 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl" (OuterVolumeSpecName: "kube-api-access-lr5cl") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "kube-api-access-lr5cl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:46:01.352003 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.351968 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:46:01.352003 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.351975 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:46:01.352228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.352204 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:01.352293 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.352267 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:01.357738 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.357710 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "28fbc0b4-f843-4899-a073-4efa6f9abde2" (UID: "28fbc0b4-f843-4899-a073-4efa6f9abde2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450001 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/28fbc0b4-f843-4899-a073-4efa6f9abde2-ca-trust-extracted\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450032 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-installation-pull-secrets\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450043 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-certificates\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450051 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/28fbc0b4-f843-4899-a073-4efa6f9abde2-image-registry-private-configuration\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450063 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-bound-sa-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450071 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/28fbc0b4-f843-4899-a073-4efa6f9abde2-trusted-ca\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450078 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr5cl\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-kube-api-access-lr5cl\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.450095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.450086 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/28fbc0b4-f843-4899-a073-4efa6f9abde2-registry-tls\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:01.633975 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.633936 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:46:01.637281 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.637252 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6477947558-8vs46"] Jul 18 00:46:01.963762 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:01.963732 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" path="/var/lib/kubelet/pods/28fbc0b4-f843-4899-a073-4efa6f9abde2/volumes" Jul 18 00:46:29.920127 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920078 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:29.920610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920404 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="alertmanager" containerID="cri-o://ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" gracePeriod=120 Jul 18 00:46:29.920610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920469 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-web" containerID="cri-o://a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" gracePeriod=120 Jul 18 00:46:29.920610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920465 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-metric" containerID="cri-o://b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" gracePeriod=120 Jul 18 00:46:29.920610 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920575 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy" containerID="cri-o://989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" gracePeriod=120 Jul 18 00:46:29.920849 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920589 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="prom-label-proxy" containerID="cri-o://11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" gracePeriod=120 Jul 18 00:46:29.920849 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:29.920629 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="config-reloader" containerID="cri-o://94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" gracePeriod=120 Jul 18 00:46:30.398112 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398075 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:46:30.398575 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398546 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerName="registry" Jul 18 00:46:30.398575 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398573 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerName="registry" Jul 18 00:46:30.398805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398606 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerName="console" Jul 18 00:46:30.398805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398616 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerName="console" Jul 18 00:46:30.398805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398718 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="28fbc0b4-f843-4899-a073-4efa6f9abde2" containerName="registry" Jul 18 00:46:30.398805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.398735 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd33662-63bf-44c3-b93c-8dd69c52addd" containerName="console" Jul 18 00:46:30.400568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.400550 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.403173 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403140 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 00:46:30.403443 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403420 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 00:46:30.403573 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7fbvj\"" Jul 18 00:46:30.403573 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403510 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 00:46:30.403573 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403541 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 00:46:30.403735 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.403608 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 00:46:30.409447 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.409272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 00:46:30.413314 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.413290 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:46:30.438697 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438671 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" exitCode=0 Jul 18 00:46:30.438697 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438692 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" exitCode=0 Jul 18 00:46:30.438697 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438697 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" exitCode=0 Jul 18 00:46:30.438697 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438702 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" exitCode=0 Jul 18 00:46:30.438958 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7"} Jul 18 00:46:30.438958 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475"} Jul 18 00:46:30.438958 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30"} Jul 18 00:46:30.438958 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.438863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2"} Jul 18 00:46:30.497437 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc76c\" (UniqueName: \"kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497655 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497848 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.497848 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.497733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598636 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598636 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc76c\" (UniqueName: \"kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.598859 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.598855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.599410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.599374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.599741 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.599448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.599741 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.599562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.599862 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.599839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.601372 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.601346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.601506 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.601467 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.610077 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.610055 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc76c\" (UniqueName: \"kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c\") pod \"console-5b9fdf4b7b-crvrf\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.712236 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.712141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:30.848854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:30.848826 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:46:30.851184 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:46:30.851159 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808f87e5_d793_405e_a897_cf43d9b2f3ef.slice/crio-c1733b0814f3ed41cbf88f892c1283a636b2526ca896f6ff82e7bfb8819ede8e WatchSource:0}: Error finding container c1733b0814f3ed41cbf88f892c1283a636b2526ca896f6ff82e7bfb8819ede8e: Status 404 returned error can't find the container with id c1733b0814f3ed41cbf88f892c1283a636b2526ca896f6ff82e7bfb8819ede8e Jul 18 00:46:31.165144 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.165121 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.204719 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204654 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204747 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204779 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204813 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204838 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204865 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.204906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204899 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204934 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dswdm\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204962 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.204987 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205046 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205073 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205115 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web\") pod \"b3182ed9-b635-413a-830d-b576d9b21e9b\" (UID: \"b3182ed9-b635-413a-830d-b576d9b21e9b\") " Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205118 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:46:31.205202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205169 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:46:31.205607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205380 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-main-db\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.205607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205396 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.205607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.205475 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:46:31.208637 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.208604 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.209766 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.209687 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume" (OuterVolumeSpecName: "config-volume") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.210206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.210180 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.210319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.210263 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.210319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.210280 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.211958 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.211917 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm" (OuterVolumeSpecName: "kube-api-access-dswdm") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "kube-api-access-dswdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:46:31.212478 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.212453 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:46:31.213583 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.213550 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out" (OuterVolumeSpecName: "config-out") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:46:31.217055 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.217016 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.223915 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.223842 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config" (OuterVolumeSpecName: "web-config") pod "b3182ed9-b635-413a-830d-b576d9b21e9b" (UID: "b3182ed9-b635-413a-830d-b576d9b21e9b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:46:31.306177 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306140 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-main-tls\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306177 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306172 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-web-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306177 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306183 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-cluster-tls-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306191 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b3182ed9-b635-413a-830d-b576d9b21e9b-config-out\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306199 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dswdm\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-kube-api-access-dswdm\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306208 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-config-volume\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306216 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3182ed9-b635-413a-830d-b576d9b21e9b-metrics-client-ca\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306225 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306233 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b3182ed9-b635-413a-830d-b576d9b21e9b-tls-assets\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306241 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.306402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.306261 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b3182ed9-b635-413a-830d-b576d9b21e9b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:46:31.446375 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446300 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" exitCode=0 Jul 18 00:46:31.446375 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446321 2577 generic.go:356] "Generic (PLEG): container finished" podID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerID="a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" exitCode=0 Jul 18 00:46:31.446375 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446375 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.446375 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1"} Jul 18 00:46:31.446676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774"} Jul 18 00:46:31.446676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b3182ed9-b635-413a-830d-b576d9b21e9b","Type":"ContainerDied","Data":"bb2a89de561733b79591dc36bcc163e97e7b81ec27b8302a04b964e77c7f7b93"} Jul 18 00:46:31.446676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.446520 2577 scope.go:117] "RemoveContainer" containerID="11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" Jul 18 00:46:31.448182 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.448156 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9fdf4b7b-crvrf" event={"ID":"808f87e5-d793-405e-a897-cf43d9b2f3ef","Type":"ContainerStarted","Data":"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5"} Jul 18 00:46:31.448321 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.448194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9fdf4b7b-crvrf" event={"ID":"808f87e5-d793-405e-a897-cf43d9b2f3ef","Type":"ContainerStarted","Data":"c1733b0814f3ed41cbf88f892c1283a636b2526ca896f6ff82e7bfb8819ede8e"} Jul 18 00:46:31.455624 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.455607 2577 scope.go:117] "RemoveContainer" containerID="b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" Jul 18 00:46:31.465439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.465415 2577 scope.go:117] "RemoveContainer" containerID="989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" Jul 18 00:46:31.473450 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.473424 2577 scope.go:117] "RemoveContainer" containerID="a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" Jul 18 00:46:31.473963 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.473867 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b9fdf4b7b-crvrf" podStartSLOduration=1.473854123 podStartE2EDuration="1.473854123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:31.47308208 +0000 UTC m=+370.007965079" watchObservedRunningTime="2026-07-18 00:46:31.473854123 +0000 UTC m=+370.008737108" Jul 18 00:46:31.481157 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.481138 2577 scope.go:117] "RemoveContainer" containerID="94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" Jul 18 00:46:31.489977 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.489951 2577 scope.go:117] "RemoveContainer" containerID="ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" Jul 18 00:46:31.490216 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.490188 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:31.494947 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.494922 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:31.501321 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.501290 2577 scope.go:117] "RemoveContainer" containerID="445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942" Jul 18 00:46:31.509088 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509069 2577 scope.go:117] "RemoveContainer" containerID="11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" Jul 18 00:46:31.509386 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.509361 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7\": container with ID starting with 11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7 not found: ID does not exist" containerID="11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" Jul 18 00:46:31.509428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509388 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7"} err="failed to get container status \"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7\": rpc error: code = NotFound desc = could not find container \"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7\": container with ID starting with 11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7 not found: ID does not exist" Jul 18 00:46:31.509428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509408 2577 scope.go:117] "RemoveContainer" containerID="b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" Jul 18 00:46:31.509669 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.509652 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1\": container with ID starting with b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1 not found: ID does not exist" containerID="b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" Jul 18 00:46:31.509705 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509676 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1"} err="failed to get container status \"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1\": rpc error: code = NotFound desc = could not find container \"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1\": container with ID starting with b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1 not found: ID does not exist" Jul 18 00:46:31.509705 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509691 2577 scope.go:117] "RemoveContainer" containerID="989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" Jul 18 00:46:31.509937 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.509921 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475\": container with ID starting with 989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475 not found: ID does not exist" containerID="989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" Jul 18 00:46:31.509983 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509941 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475"} err="failed to get container status \"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475\": rpc error: code = NotFound desc = could not find container \"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475\": container with ID starting with 989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475 not found: ID does not exist" Jul 18 00:46:31.509983 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.509953 2577 scope.go:117] "RemoveContainer" containerID="a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" Jul 18 00:46:31.510182 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.510160 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774\": container with ID starting with a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774 not found: ID does not exist" containerID="a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" Jul 18 00:46:31.510286 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510184 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774"} err="failed to get container status \"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774\": rpc error: code = NotFound desc = could not find container \"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774\": container with ID starting with a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774 not found: ID does not exist" Jul 18 00:46:31.510286 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510199 2577 scope.go:117] "RemoveContainer" containerID="94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" Jul 18 00:46:31.510386 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.510369 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30\": container with ID starting with 94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30 not found: ID does not exist" containerID="94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" Jul 18 00:46:31.510419 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510383 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30"} err="failed to get container status \"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30\": rpc error: code = NotFound desc = could not find container \"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30\": container with ID starting with 94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30 not found: ID does not exist" Jul 18 00:46:31.510419 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510394 2577 scope.go:117] "RemoveContainer" containerID="ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" Jul 18 00:46:31.510633 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.510616 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2\": container with ID starting with ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2 not found: ID does not exist" containerID="ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" Jul 18 00:46:31.510704 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510637 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2"} err="failed to get container status \"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2\": rpc error: code = NotFound desc = could not find container \"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2\": container with ID starting with ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2 not found: ID does not exist" Jul 18 00:46:31.510704 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510650 2577 scope.go:117] "RemoveContainer" containerID="445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942" Jul 18 00:46:31.510866 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:46:31.510847 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942\": container with ID starting with 445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942 not found: ID does not exist" containerID="445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942" Jul 18 00:46:31.510906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510871 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942"} err="failed to get container status \"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942\": rpc error: code = NotFound desc = could not find container \"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942\": container with ID starting with 445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942 not found: ID does not exist" Jul 18 00:46:31.510906 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.510884 2577 scope.go:117] "RemoveContainer" containerID="11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7" Jul 18 00:46:31.511136 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511109 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7"} err="failed to get container status \"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7\": rpc error: code = NotFound desc = could not find container \"11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7\": container with ID starting with 11b71a0435e56e3ef3c11bcbd5820056fd213ecc1f876496a5b64061de6f56f7 not found: ID does not exist" Jul 18 00:46:31.511136 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511127 2577 scope.go:117] "RemoveContainer" containerID="b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1" Jul 18 00:46:31.511354 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511337 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1"} err="failed to get container status \"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1\": rpc error: code = NotFound desc = could not find container \"b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1\": container with ID starting with b38f64ee24d6ec5a35d58430ba9169a9cdc76ebd96ffcc6fc427afe80622e3e1 not found: ID does not exist" Jul 18 00:46:31.511403 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511355 2577 scope.go:117] "RemoveContainer" containerID="989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475" Jul 18 00:46:31.511587 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511566 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475"} err="failed to get container status \"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475\": rpc error: code = NotFound desc = could not find container \"989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475\": container with ID starting with 989c51d047d1004596c7c57604970059590275c18cf761bda4ce15dfba45f475 not found: ID does not exist" Jul 18 00:46:31.511651 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511587 2577 scope.go:117] "RemoveContainer" containerID="a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774" Jul 18 00:46:31.511814 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511798 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774"} err="failed to get container status \"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774\": rpc error: code = NotFound desc = could not find container \"a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774\": container with ID starting with a483a92feecdbb68789d3a4ef99d68c410ed539346a9ba671be4e38a3450f774 not found: ID does not exist" Jul 18 00:46:31.511854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511814 2577 scope.go:117] "RemoveContainer" containerID="94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30" Jul 18 00:46:31.512011 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.511992 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30"} err="failed to get container status \"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30\": rpc error: code = NotFound desc = could not find container \"94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30\": container with ID starting with 94144e660a6e82b1317f18fd9f966027aa4a549050dadeb21b82768d8e267d30 not found: ID does not exist" Jul 18 00:46:31.512073 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.512012 2577 scope.go:117] "RemoveContainer" containerID="ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2" Jul 18 00:46:31.512289 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.512272 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2"} err="failed to get container status \"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2\": rpc error: code = NotFound desc = could not find container \"ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2\": container with ID starting with ad6d20f0196bdfae4d54412bcfac608e471432bd416223ce968cec0a0eafbda2 not found: ID does not exist" Jul 18 00:46:31.512352 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.512290 2577 scope.go:117] "RemoveContainer" containerID="445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942" Jul 18 00:46:31.512542 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.512517 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942"} err="failed to get container status \"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942\": rpc error: code = NotFound desc = could not find container \"445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942\": container with ID starting with 445ecff3ac81715b497b619204f98045423df6bd0a7aed9944896bfda311a942 not found: ID does not exist" Jul 18 00:46:31.522173 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522150 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:31.522473 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522461 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-web" Jul 18 00:46:31.522533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522475 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-web" Jul 18 00:46:31.522533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522512 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="prom-label-proxy" Jul 18 00:46:31.522533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522522 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="prom-label-proxy" Jul 18 00:46:31.522533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522532 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="init-config-reloader" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522538 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="init-config-reloader" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522550 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522555 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522564 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="alertmanager" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522568 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="alertmanager" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522574 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="config-reloader" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522579 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="config-reloader" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522586 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-metric" Jul 18 00:46:31.522644 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522596 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-metric" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522649 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-metric" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522657 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="prom-label-proxy" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522667 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="alertmanager" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522675 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy-web" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522682 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="config-reloader" Jul 18 00:46:31.522884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.522687 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" containerName="kube-rbac-proxy" Jul 18 00:46:31.526529 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.526510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.529386 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 00:46:31.529563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529371 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 00:46:31.529563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529435 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 00:46:31.529563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 00:46:31.529563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529371 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 00:46:31.529563 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 00:46:31.529822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529612 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cdkk9\"" Jul 18 00:46:31.529822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529745 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 00:46:31.529822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.529776 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 00:46:31.534970 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.534948 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 00:46:31.544047 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.543872 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:31.608821 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608785 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.608821 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.608989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvlm\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-kube-api-access-7bvlm\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609072 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609317 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-out\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609317 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609317 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-web-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609317 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.609317 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.609215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710550 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvlm\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-kube-api-access-7bvlm\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.710739 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710708 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-out\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-web-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710879 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711009 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.710900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711293 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.711212 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711347 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.711319 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.711725 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.711700 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9dde765-c901-4474-bdaf-d75e8e6f9492-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.713834 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.713678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714074 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.713978 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714074 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.713990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-out\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714074 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.713997 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714284 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.714261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714353 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.714332 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714419 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.714403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.714798 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.714777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-web-config\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.715708 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.715691 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c9dde765-c901-4474-bdaf-d75e8e6f9492-config-volume\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.718689 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.718668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvlm\" (UniqueName: \"kubernetes.io/projected/c9dde765-c901-4474-bdaf-d75e8e6f9492-kube-api-access-7bvlm\") pod \"alertmanager-main-0\" (UID: \"c9dde765-c901-4474-bdaf-d75e8e6f9492\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.837105 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.837076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:46:31.964649 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.964615 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3182ed9-b635-413a-830d-b576d9b21e9b" path="/var/lib/kubelet/pods/b3182ed9-b635-413a-830d-b576d9b21e9b/volumes" Jul 18 00:46:31.979399 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:31.979368 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:46:31.982880 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:46:31.982855 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9dde765_c901_4474_bdaf_d75e8e6f9492.slice/crio-ff917b86a2aec99db5f95e3c51e105b7eabd868b92dd419319c0227ff4fbc535 WatchSource:0}: Error finding container ff917b86a2aec99db5f95e3c51e105b7eabd868b92dd419319c0227ff4fbc535: Status 404 returned error can't find the container with id ff917b86a2aec99db5f95e3c51e105b7eabd868b92dd419319c0227ff4fbc535 Jul 18 00:46:32.454909 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:32.454873 2577 generic.go:356] "Generic (PLEG): container finished" podID="c9dde765-c901-4474-bdaf-d75e8e6f9492" containerID="bbde26d31a43fe2b029bd81e32d1e57f1c3c3146229b996d14f802fb01b91968" exitCode=0 Jul 18 00:46:32.455315 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:32.454952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerDied","Data":"bbde26d31a43fe2b029bd81e32d1e57f1c3c3146229b996d14f802fb01b91968"} Jul 18 00:46:32.455315 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:32.455025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"ff917b86a2aec99db5f95e3c51e105b7eabd868b92dd419319c0227ff4fbc535"} Jul 18 00:46:33.462969 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.462927 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"b07e6acc4d430c935cb6e85a18cc0206d8e94d72f7a82d2086fb0edd0cb9e5a3"} Jul 18 00:46:33.463568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.463043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"c211b91d5064864756b191feb78058830e07e0b2a9cf328305ab1ec688ab6b0d"} Jul 18 00:46:33.463568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.463085 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"2ba628150cb48f41bb9bdf8ade6a6a62ac293b97dce9a6da57da224d8b6e3ae9"} Jul 18 00:46:33.463568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.463133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"ab675c187fef03bcad88920f4d70fbcdf8d4f945e982be6b3066569224c5da65"} Jul 18 00:46:33.463568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.463168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"c242f3b8208cdde80522c9c06fc8c99ad0b3596e676190394097439972fa0732"} Jul 18 00:46:33.463568 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.463205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c9dde765-c901-4474-bdaf-d75e8e6f9492","Type":"ContainerStarted","Data":"88f71af8935039afe093fb2d21ba5ba0cafedc2fdb9b2558abe7978baacc87c4"} Jul 18 00:46:33.489016 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:33.488961 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.472276552 podStartE2EDuration="2.488942647s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.666095ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:33.486208407 +0000 UTC m=+372.021091394" watchObservedRunningTime="2026-07-18 00:46:33.488942647 +0000 UTC m=+372.023825653" Jul 18 00:46:35.749995 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:35.749955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:46:35.752521 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:35.752479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/753ad8ea-6811-45d6-9e4b-ae2041db9c5b-metrics-certs\") pod \"network-metrics-daemon-ggk8j\" (UID: \"753ad8ea-6811-45d6-9e4b-ae2041db9c5b\") " pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:46:35.865107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:35.865069 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\"" Jul 18 00:46:35.872825 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:35.872792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggk8j" Jul 18 00:46:36.003601 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:36.003567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggk8j"] Jul 18 00:46:36.006385 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:46:36.006361 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753ad8ea_6811_45d6_9e4b_ae2041db9c5b.slice/crio-57e2aaa156db3ce39e0d5d8718737c97a5bb1582a3e839e59d98b17f1b171442 WatchSource:0}: Error finding container 57e2aaa156db3ce39e0d5d8718737c97a5bb1582a3e839e59d98b17f1b171442: Status 404 returned error can't find the container with id 57e2aaa156db3ce39e0d5d8718737c97a5bb1582a3e839e59d98b17f1b171442 Jul 18 00:46:36.008819 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:36.008802 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:46:36.478569 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:36.478533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggk8j" event={"ID":"753ad8ea-6811-45d6-9e4b-ae2041db9c5b","Type":"ContainerStarted","Data":"57e2aaa156db3ce39e0d5d8718737c97a5bb1582a3e839e59d98b17f1b171442"} Jul 18 00:46:37.485379 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:37.485290 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggk8j" event={"ID":"753ad8ea-6811-45d6-9e4b-ae2041db9c5b","Type":"ContainerStarted","Data":"e761820af96e1d3169a79cac8650f98617dd06922ba3d3bc991bb19693fcddb0"} Jul 18 00:46:37.485379 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:37.485340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggk8j" event={"ID":"753ad8ea-6811-45d6-9e4b-ae2041db9c5b","Type":"ContainerStarted","Data":"59ce1f5148f346e5809474692d89a8e87aa558ec3acab76eaa382e4e45f39560"} Jul 18 00:46:37.503943 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:37.503887 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggk8j" podStartSLOduration=374.351516894 podStartE2EDuration="6m15.503871264s" totalImagesPullingTime="1.15235437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:46:37.502579979 +0000 UTC m=+376.037462966" watchObservedRunningTime="2026-07-18 00:46:37.503871264 +0000 UTC m=+376.038754252" Jul 18 00:46:40.712598 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:40.712555 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:40.713013 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:40.712621 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:40.717683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:40.717658 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:46:41.504295 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:46:41.504265 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:47:05.899183 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.899147 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd"] Jul 18 00:47:05.902052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.902027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:05.904998 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.904968 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:47:05.905138 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.905033 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:47:05.905138 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.905053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9gd4g\"" Jul 18 00:47:05.911318 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:05.911284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd"] Jul 18 00:47:06.013153 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.013125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.013594 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.013164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.013888 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.013865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps98q\" (UniqueName: \"kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.114973 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.114932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps98q\" (UniqueName: \"kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.114973 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.114992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.115253 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.115021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.115439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.115417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.115439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.115434 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.123922 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.123883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps98q\" (UniqueName: \"kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.212542 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.212458 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:06.360745 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.360719 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd"] Jul 18 00:47:06.363122 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:06.363087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf281ae64_ba84_4ec8_8639_75c35347b8b5.slice/crio-c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5 WatchSource:0}: Error finding container c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5: Status 404 returned error can't find the container with id c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5 Jul 18 00:47:06.597875 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:06.597841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" event={"ID":"f281ae64-ba84-4ec8-8639-75c35347b8b5","Type":"ContainerStarted","Data":"c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5"} Jul 18 00:47:12.630417 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:12.630374 2577 generic.go:356] "Generic (PLEG): container finished" podID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerID="1793b1a0468346627d78578b2e2186beda6bc98f9dee77c3e79c76533f12ffde" exitCode=0 Jul 18 00:47:12.630804 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:12.630453 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" event={"ID":"f281ae64-ba84-4ec8-8639-75c35347b8b5","Type":"ContainerDied","Data":"1793b1a0468346627d78578b2e2186beda6bc98f9dee77c3e79c76533f12ffde"} Jul 18 00:47:15.646713 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:15.646675 2577 generic.go:356] "Generic (PLEG): container finished" podID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerID="1c8fa2fd8da278aed7b523f5f54a29131cda88ab7d0a255b488b06d75d2f2c5b" exitCode=0 Jul 18 00:47:15.647095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:15.646745 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" event={"ID":"f281ae64-ba84-4ec8-8639-75c35347b8b5","Type":"ContainerDied","Data":"1c8fa2fd8da278aed7b523f5f54a29131cda88ab7d0a255b488b06d75d2f2c5b"} Jul 18 00:47:22.685327 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:22.685286 2577 generic.go:356] "Generic (PLEG): container finished" podID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerID="193b500923ec042b2f13aaae14d48e8c640795e6797cf47c9f47cce537297af2" exitCode=0 Jul 18 00:47:22.685742 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:22.685358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" event={"ID":"f281ae64-ba84-4ec8-8639-75c35347b8b5","Type":"ContainerDied","Data":"193b500923ec042b2f13aaae14d48e8c640795e6797cf47c9f47cce537297af2"} Jul 18 00:47:23.824294 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.824267 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:23.867498 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.867443 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util\") pod \"f281ae64-ba84-4ec8-8639-75c35347b8b5\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " Jul 18 00:47:23.867687 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.867532 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps98q\" (UniqueName: \"kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q\") pod \"f281ae64-ba84-4ec8-8639-75c35347b8b5\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " Jul 18 00:47:23.867687 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.867565 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle\") pod \"f281ae64-ba84-4ec8-8639-75c35347b8b5\" (UID: \"f281ae64-ba84-4ec8-8639-75c35347b8b5\") " Jul 18 00:47:23.868287 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.868196 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle" (OuterVolumeSpecName: "bundle") pod "f281ae64-ba84-4ec8-8639-75c35347b8b5" (UID: "f281ae64-ba84-4ec8-8639-75c35347b8b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:23.869890 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.869859 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q" (OuterVolumeSpecName: "kube-api-access-ps98q") pod "f281ae64-ba84-4ec8-8639-75c35347b8b5" (UID: "f281ae64-ba84-4ec8-8639-75c35347b8b5"). InnerVolumeSpecName "kube-api-access-ps98q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:47:23.871261 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.871240 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util" (OuterVolumeSpecName: "util") pod "f281ae64-ba84-4ec8-8639-75c35347b8b5" (UID: "f281ae64-ba84-4ec8-8639-75c35347b8b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:23.968743 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.968660 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:23.968743 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.968688 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps98q\" (UniqueName: \"kubernetes.io/projected/f281ae64-ba84-4ec8-8639-75c35347b8b5-kube-api-access-ps98q\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:23.968743 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:23.968698 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f281ae64-ba84-4ec8-8639-75c35347b8b5-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:24.695363 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:24.695320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" event={"ID":"f281ae64-ba84-4ec8-8639-75c35347b8b5","Type":"ContainerDied","Data":"c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5"} Jul 18 00:47:24.695569 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:24.695367 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408fnfd" Jul 18 00:47:24.695569 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:24.695380 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c59f5359587ec088910eaed4bbbb73d51c420b5a93e840a37e4b2dff1adceba5" Jul 18 00:47:33.309974 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.309932 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff"] Jul 18 00:47:33.310395 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310276 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="util" Jul 18 00:47:33.310395 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310290 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="util" Jul 18 00:47:33.310395 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310299 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="pull" Jul 18 00:47:33.310395 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310305 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="pull" Jul 18 00:47:33.310395 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310392 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="extract" Jul 18 00:47:33.310674 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310405 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="extract" Jul 18 00:47:33.310674 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.310462 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f281ae64-ba84-4ec8-8639-75c35347b8b5" containerName="extract" Jul 18 00:47:33.314342 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.314322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.317025 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.316995 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:47:33.317025 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.316994 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:47:33.318462 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.318440 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9gd4g\"" Jul 18 00:47:33.324663 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.324634 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff"] Jul 18 00:47:33.446839 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.446794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.447041 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.446875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.447041 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.446923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5f5p\" (UniqueName: \"kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.548143 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.548094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.548343 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.548166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.548343 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.548202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5f5p\" (UniqueName: \"kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.548598 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.548575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.548669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.548586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.558519 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.558479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5f5p\" (UniqueName: \"kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.624612 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.624512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:33.769175 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:33.769149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff"] Jul 18 00:47:33.771542 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:33.771510 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb417995b_50f1_4d51_a3db_1502123383eb.slice/crio-7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148 WatchSource:0}: Error finding container 7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148: Status 404 returned error can't find the container with id 7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148 Jul 18 00:47:34.739407 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.739368 2577 generic.go:356] "Generic (PLEG): container finished" podID="b417995b-50f1-4d51-a3db-1502123383eb" containerID="f5ffffc2e0b22a6059ef9a31aa9b46df7f28857a7c413482df98728f4c435607" exitCode=0 Jul 18 00:47:34.739854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.739414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerDied","Data":"f5ffffc2e0b22a6059ef9a31aa9b46df7f28857a7c413482df98728f4c435607"} Jul 18 00:47:34.739854 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.739451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerStarted","Data":"7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148"} Jul 18 00:47:34.908001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.907911 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv"] Jul 18 00:47:34.910208 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.910191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:34.912975 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.912936 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 00:47:34.912975 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.912955 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 00:47:34.913204 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.913063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nwtd9\"" Jul 18 00:47:34.919694 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.919664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv"] Jul 18 00:47:34.961936 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.961887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:34.962096 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:34.961946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6v84\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-kube-api-access-h6v84\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.062925 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.062884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.063119 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.062948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6v84\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-kube-api-access-h6v84\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.071179 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.071146 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.071351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.071333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6v84\" (UniqueName: \"kubernetes.io/projected/00d210d9-603a-4431-a2cd-5dba88dfdb56-kube-api-access-h6v84\") pod \"cert-manager-cainjector-559cdd8c87-g6jfv\" (UID: \"00d210d9-603a-4431-a2cd-5dba88dfdb56\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.233328 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.233234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" Jul 18 00:47:35.366066 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.366039 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv"] Jul 18 00:47:35.368544 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:35.368519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00d210d9_603a_4431_a2cd_5dba88dfdb56.slice/crio-8f9d0d7bd3d4103ec98f0b17d326403cc6de6f8dba92898b341c635e5d70c36b WatchSource:0}: Error finding container 8f9d0d7bd3d4103ec98f0b17d326403cc6de6f8dba92898b341c635e5d70c36b: Status 404 returned error can't find the container with id 8f9d0d7bd3d4103ec98f0b17d326403cc6de6f8dba92898b341c635e5d70c36b Jul 18 00:47:35.746084 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:35.746042 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" event={"ID":"00d210d9-603a-4431-a2cd-5dba88dfdb56","Type":"ContainerStarted","Data":"8f9d0d7bd3d4103ec98f0b17d326403cc6de6f8dba92898b341c635e5d70c36b"} Jul 18 00:47:36.754014 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:36.753970 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerStarted","Data":"faae6fc551bae594f3cc31a79d235de1fd3bfff7d5e9fe1386143c9cc77f7ea4"} Jul 18 00:47:37.761268 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:37.761230 2577 generic.go:356] "Generic (PLEG): container finished" podID="b417995b-50f1-4d51-a3db-1502123383eb" containerID="faae6fc551bae594f3cc31a79d235de1fd3bfff7d5e9fe1386143c9cc77f7ea4" exitCode=0 Jul 18 00:47:37.761751 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:37.761292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerDied","Data":"faae6fc551bae594f3cc31a79d235de1fd3bfff7d5e9fe1386143c9cc77f7ea4"} Jul 18 00:47:38.768894 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.768857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" event={"ID":"00d210d9-603a-4431-a2cd-5dba88dfdb56","Type":"ContainerStarted","Data":"8c01da620fd9bfacc63e1678a05d2300f0fb1a91fc62a8a488a64fc920d553e8"} Jul 18 00:47:38.771305 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.771278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerStarted","Data":"f3eb711b38caa11dc7e91b25b0e0310e0de4991641dc7c3415f15ece23e6c867"} Jul 18 00:47:38.786095 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.786040 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6jfv" podStartSLOduration=1.514719121 podStartE2EDuration="4.786022904s" totalImagesPullingTime="3.271303783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:38.784527131 +0000 UTC m=+437.319410121" watchObservedRunningTime="2026-07-18 00:47:38.786022904 +0000 UTC m=+437.320905891" Jul 18 00:47:38.875832 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.875738 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5x2d"] Jul 18 00:47:38.878784 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.878751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:38.881436 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.881409 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kjxx2\"" Jul 18 00:47:38.886642 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.886612 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5x2d"] Jul 18 00:47:38.997031 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.996989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:38.997210 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:38.997078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fhc\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-kube-api-access-m5fhc\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.097673 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.097624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.098388 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.098357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fhc\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-kube-api-access-m5fhc\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.106372 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.106340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.106676 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.106652 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fhc\" (UniqueName: \"kubernetes.io/projected/bf0a6535-d534-46d5-be66-ca90ef2ad180-kube-api-access-m5fhc\") pod \"cert-manager-webhook-6486ffd997-c5x2d\" (UID: \"bf0a6535-d534-46d5-be66-ca90ef2ad180\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.190452 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.190364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.329029 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.329000 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5x2d"] Jul 18 00:47:39.331476 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:39.331449 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf0a6535_d534_46d5_be66_ca90ef2ad180.slice/crio-c82eaf8f088d9230316ddaf03fd5389baa51356db5940e02d2decb0ab8b85ea6 WatchSource:0}: Error finding container c82eaf8f088d9230316ddaf03fd5389baa51356db5940e02d2decb0ab8b85ea6: Status 404 returned error can't find the container with id c82eaf8f088d9230316ddaf03fd5389baa51356db5940e02d2decb0ab8b85ea6 Jul 18 00:47:39.779206 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.779159 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" event={"ID":"bf0a6535-d534-46d5-be66-ca90ef2ad180","Type":"ContainerStarted","Data":"74a6afd1f4969e59dac0df85e40f1b3575662db9e1ba548fb6fde613271720fe"} Jul 18 00:47:39.779708 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.779219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" event={"ID":"bf0a6535-d534-46d5-be66-ca90ef2ad180","Type":"ContainerStarted","Data":"c82eaf8f088d9230316ddaf03fd5389baa51356db5940e02d2decb0ab8b85ea6"} Jul 18 00:47:39.779708 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.779237 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:39.781303 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.781278 2577 generic.go:356] "Generic (PLEG): container finished" podID="b417995b-50f1-4d51-a3db-1502123383eb" containerID="f3eb711b38caa11dc7e91b25b0e0310e0de4991641dc7c3415f15ece23e6c867" exitCode=0 Jul 18 00:47:39.781431 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.781341 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerDied","Data":"f3eb711b38caa11dc7e91b25b0e0310e0de4991641dc7c3415f15ece23e6c867"} Jul 18 00:47:39.918328 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.918296 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:39.939373 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:39.939322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" podStartSLOduration=1.939298725 podStartE2EDuration="1.939298725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:39.798356812 +0000 UTC m=+438.333239801" watchObservedRunningTime="2026-07-18 00:47:39.939298725 +0000 UTC m=+438.474181711" Jul 18 00:47:40.008658 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.008623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5f5p\" (UniqueName: \"kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p\") pod \"b417995b-50f1-4d51-a3db-1502123383eb\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " Jul 18 00:47:40.008870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.008669 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util\") pod \"b417995b-50f1-4d51-a3db-1502123383eb\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " Jul 18 00:47:40.008870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.008716 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle\") pod \"b417995b-50f1-4d51-a3db-1502123383eb\" (UID: \"b417995b-50f1-4d51-a3db-1502123383eb\") " Jul 18 00:47:40.009145 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.009119 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle" (OuterVolumeSpecName: "bundle") pod "b417995b-50f1-4d51-a3db-1502123383eb" (UID: "b417995b-50f1-4d51-a3db-1502123383eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:40.010892 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.010864 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p" (OuterVolumeSpecName: "kube-api-access-k5f5p") pod "b417995b-50f1-4d51-a3db-1502123383eb" (UID: "b417995b-50f1-4d51-a3db-1502123383eb"). InnerVolumeSpecName "kube-api-access-k5f5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:47:40.013723 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.013699 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util" (OuterVolumeSpecName: "util") pod "b417995b-50f1-4d51-a3db-1502123383eb" (UID: "b417995b-50f1-4d51-a3db-1502123383eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:40.110186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.110144 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:40.110186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.110182 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5f5p\" (UniqueName: \"kubernetes.io/projected/b417995b-50f1-4d51-a3db-1502123383eb-kube-api-access-k5f5p\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:40.110186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.110194 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b417995b-50f1-4d51-a3db-1502123383eb-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:40.787991 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.787966 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" Jul 18 00:47:40.788406 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.787999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxpqff" event={"ID":"b417995b-50f1-4d51-a3db-1502123383eb","Type":"ContainerDied","Data":"7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148"} Jul 18 00:47:40.788406 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:40.788049 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ec6a2f09d936bdaa159adb5adfbe24a20ee59b92f33eea8c9af4f3e8a340148" Jul 18 00:47:45.790964 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:45.790888 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5x2d" Jul 18 00:47:46.487402 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487367 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn"] Jul 18 00:47:46.487712 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487698 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="pull" Jul 18 00:47:46.487778 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487713 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="pull" Jul 18 00:47:46.487778 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487727 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="util" Jul 18 00:47:46.487778 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487733 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="util" Jul 18 00:47:46.487778 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487745 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="extract" Jul 18 00:47:46.487778 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487751 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="extract" Jul 18 00:47:46.487920 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.487796 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b417995b-50f1-4d51-a3db-1502123383eb" containerName="extract" Jul 18 00:47:46.490663 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.490646 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.493311 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.493276 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:47:46.493450 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.493339 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 00:47:46.494435 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.494410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7x64k\"" Jul 18 00:47:46.502654 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.502630 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn"] Jul 18 00:47:46.568904 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.568860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02f0f888-fc1a-47cd-880e-5a145c3c11c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.568904 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.568906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dnl\" (UniqueName: \"kubernetes.io/projected/02f0f888-fc1a-47cd-880e-5a145c3c11c8-kube-api-access-h9dnl\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.670287 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.670245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02f0f888-fc1a-47cd-880e-5a145c3c11c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.670287 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.670286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dnl\" (UniqueName: \"kubernetes.io/projected/02f0f888-fc1a-47cd-880e-5a145c3c11c8-kube-api-access-h9dnl\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.670679 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.670659 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02f0f888-fc1a-47cd-880e-5a145c3c11c8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.678575 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.678553 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dnl\" (UniqueName: \"kubernetes.io/projected/02f0f888-fc1a-47cd-880e-5a145c3c11c8-kube-api-access-h9dnl\") pod \"openshift-lws-operator-fd8ccff4c-9s5zn\" (UID: \"02f0f888-fc1a-47cd-880e-5a145c3c11c8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.800254 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.800160 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" Jul 18 00:47:46.936098 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:46.936071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn"] Jul 18 00:47:46.938863 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:46.938833 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02f0f888_fc1a_47cd_880e_5a145c3c11c8.slice/crio-cf981cd1bf9c859c12dc1f76853d372758ba7ae0b5df20384448a6d95185a524 WatchSource:0}: Error finding container cf981cd1bf9c859c12dc1f76853d372758ba7ae0b5df20384448a6d95185a524: Status 404 returned error can't find the container with id cf981cd1bf9c859c12dc1f76853d372758ba7ae0b5df20384448a6d95185a524 Jul 18 00:47:47.826671 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:47.826631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" event={"ID":"02f0f888-fc1a-47cd-880e-5a145c3c11c8","Type":"ContainerStarted","Data":"cf981cd1bf9c859c12dc1f76853d372758ba7ae0b5df20384448a6d95185a524"} Jul 18 00:47:48.833319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:48.833278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" event={"ID":"02f0f888-fc1a-47cd-880e-5a145c3c11c8","Type":"ContainerStarted","Data":"2e98b3e40ca1b3f3a1d2ba5dbc8bc6ea61741c8befbb4b8a842cd24c9a22275d"} Jul 18 00:47:48.850645 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:48.850581 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9s5zn" podStartSLOduration=1.253257389 podStartE2EDuration="2.850557508s" totalImagesPullingTime="1.597300119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:48.848998907 +0000 UTC m=+447.383881899" watchObservedRunningTime="2026-07-18 00:47:48.850557508 +0000 UTC m=+447.385440517" Jul 18 00:47:54.190470 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.190428 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4"] Jul 18 00:47:54.194102 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.194084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.196835 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.196811 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:47:54.197002 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.196984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9gd4g\"" Jul 18 00:47:54.197096 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.197074 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:47:54.202474 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.202450 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4"] Jul 18 00:47:54.339708 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.339675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.339883 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.339719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.339883 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.339793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6j8f\" (UniqueName: \"kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.441044 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.440942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.441044 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.440993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.441286 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.441123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6j8f\" (UniqueName: \"kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.441350 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.441333 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.441424 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.441398 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.450543 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.450505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6j8f\" (UniqueName: \"kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.504337 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.504297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:54.644337 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.644313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4"] Jul 18 00:47:54.646216 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:47:54.646188 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16a54bd_d1a0_4105_85e6_9a90c19147d5.slice/crio-18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae WatchSource:0}: Error finding container 18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae: Status 404 returned error can't find the container with id 18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae Jul 18 00:47:54.861847 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.861811 2577 generic.go:356] "Generic (PLEG): container finished" podID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerID="f21b7ad7f8e1e80362e9750f5181a3bae25df91a475c1d5e71b235178c31f94d" exitCode=0 Jul 18 00:47:54.862027 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.861867 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" event={"ID":"b16a54bd-d1a0-4105-85e6-9a90c19147d5","Type":"ContainerDied","Data":"f21b7ad7f8e1e80362e9750f5181a3bae25df91a475c1d5e71b235178c31f94d"} Jul 18 00:47:54.862027 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:54.861919 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" event={"ID":"b16a54bd-d1a0-4105-85e6-9a90c19147d5","Type":"ContainerStarted","Data":"18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae"} Jul 18 00:47:56.873705 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:56.873672 2577 generic.go:356] "Generic (PLEG): container finished" podID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerID="3df615baf7100ea2b98496622f10d9458f2e3e3de43eceeed785a739061cde54" exitCode=0 Jul 18 00:47:56.874103 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:56.873712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" event={"ID":"b16a54bd-d1a0-4105-85e6-9a90c19147d5","Type":"ContainerDied","Data":"3df615baf7100ea2b98496622f10d9458f2e3e3de43eceeed785a739061cde54"} Jul 18 00:47:57.883158 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:57.883122 2577 generic.go:356] "Generic (PLEG): container finished" podID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerID="ea0081f2f7d956076ea2d8e8c38f647b1d454b1c7755d877552c47a66df5bfd5" exitCode=0 Jul 18 00:47:57.883661 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:57.883207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" event={"ID":"b16a54bd-d1a0-4105-85e6-9a90c19147d5","Type":"ContainerDied","Data":"ea0081f2f7d956076ea2d8e8c38f647b1d454b1c7755d877552c47a66df5bfd5"} Jul 18 00:47:59.025748 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.025723 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:59.182240 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.182146 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle\") pod \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " Jul 18 00:47:59.182240 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.182206 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util\") pod \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " Jul 18 00:47:59.182471 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.182250 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6j8f\" (UniqueName: \"kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f\") pod \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\" (UID: \"b16a54bd-d1a0-4105-85e6-9a90c19147d5\") " Jul 18 00:47:59.182921 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.182886 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle" (OuterVolumeSpecName: "bundle") pod "b16a54bd-d1a0-4105-85e6-9a90c19147d5" (UID: "b16a54bd-d1a0-4105-85e6-9a90c19147d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:59.184508 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.184458 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f" (OuterVolumeSpecName: "kube-api-access-r6j8f") pod "b16a54bd-d1a0-4105-85e6-9a90c19147d5" (UID: "b16a54bd-d1a0-4105-85e6-9a90c19147d5"). InnerVolumeSpecName "kube-api-access-r6j8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:47:59.187919 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.187873 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util" (OuterVolumeSpecName: "util") pod "b16a54bd-d1a0-4105-85e6-9a90c19147d5" (UID: "b16a54bd-d1a0-4105-85e6-9a90c19147d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:47:59.282864 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.282818 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:59.282864 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.282855 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b16a54bd-d1a0-4105-85e6-9a90c19147d5-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:59.282864 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.282868 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6j8f\" (UniqueName: \"kubernetes.io/projected/b16a54bd-d1a0-4105-85e6-9a90c19147d5-kube-api-access-r6j8f\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:47:59.895229 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.895201 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" Jul 18 00:47:59.895397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.895230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw8nx4" event={"ID":"b16a54bd-d1a0-4105-85e6-9a90c19147d5","Type":"ContainerDied","Data":"18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae"} Jul 18 00:47:59.895397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:47:59.895273 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18649d1b0acccc2e3fd305f0bf126ca12fb7ed0e2f79c4cf7592940a547ac9ae" Jul 18 00:48:07.159092 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159054 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th"] Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159372 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="pull" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159383 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="pull" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159398 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="extract" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159404 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="extract" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159412 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="util" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159418 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="util" Jul 18 00:48:07.159551 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.159501 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b16a54bd-d1a0-4105-85e6-9a90c19147d5" containerName="extract" Jul 18 00:48:07.161728 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.161702 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.171322 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.171298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 00:48:07.171803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.171777 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8pvjh\"" Jul 18 00:48:07.172001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.171984 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 00:48:07.172089 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.171988 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 00:48:07.172473 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.172456 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 00:48:07.183301 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.183274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th"] Jul 18 00:48:07.245894 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.245860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.245894 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.245893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.246107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.245918 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.246107 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.245984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.246179 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.246103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snznw\" (UniqueName: \"kubernetes.io/projected/d560c2e9-1b20-4e1b-baea-fb4e10de8698-kube-api-access-snznw\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.346765 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.346721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.346765 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.346769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.347100 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.346914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.347100 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.346958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.347100 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.347056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snznw\" (UniqueName: \"kubernetes.io/projected/d560c2e9-1b20-4e1b-baea-fb4e10de8698-kube-api-access-snznw\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.347367 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.347348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.349661 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.349627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.349835 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.349813 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d560c2e9-1b20-4e1b-baea-fb4e10de8698-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.350080 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.350059 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d560c2e9-1b20-4e1b-baea-fb4e10de8698-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.362812 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.362774 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snznw\" (UniqueName: \"kubernetes.io/projected/d560c2e9-1b20-4e1b-baea-fb4e10de8698-kube-api-access-snznw\") pod \"opendatahub-operator-controller-manager-794f69c6d-jt6th\" (UID: \"d560c2e9-1b20-4e1b-baea-fb4e10de8698\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.473040 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.472944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:07.619354 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.619325 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th"] Jul 18 00:48:07.621304 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:48:07.621275 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd560c2e9_1b20_4e1b_baea_fb4e10de8698.slice/crio-80633783cef7880d66f95c1d15902b3ff3ccb2ade8711108620ad285508106ca WatchSource:0}: Error finding container 80633783cef7880d66f95c1d15902b3ff3ccb2ade8711108620ad285508106ca: Status 404 returned error can't find the container with id 80633783cef7880d66f95c1d15902b3ff3ccb2ade8711108620ad285508106ca Jul 18 00:48:07.934260 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:07.934225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" event={"ID":"d560c2e9-1b20-4e1b-baea-fb4e10de8698","Type":"ContainerStarted","Data":"80633783cef7880d66f95c1d15902b3ff3ccb2ade8711108620ad285508106ca"} Jul 18 00:48:10.952466 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:10.952358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" event={"ID":"d560c2e9-1b20-4e1b-baea-fb4e10de8698","Type":"ContainerStarted","Data":"4076bd324d805c27189fb2c8fcad705c4eafa22378fd29d6815563cfbc01b95e"} Jul 18 00:48:11.959081 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:11.959045 2577 generic.go:356] "Generic (PLEG): container finished" podID="d560c2e9-1b20-4e1b-baea-fb4e10de8698" containerID="4076bd324d805c27189fb2c8fcad705c4eafa22378fd29d6815563cfbc01b95e" exitCode=0 Jul 18 00:48:11.964445 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:11.964420 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" event={"ID":"d560c2e9-1b20-4e1b-baea-fb4e10de8698","Type":"ContainerDied","Data":"4076bd324d805c27189fb2c8fcad705c4eafa22378fd29d6815563cfbc01b95e"} Jul 18 00:48:12.965544 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:12.965505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" event={"ID":"d560c2e9-1b20-4e1b-baea-fb4e10de8698","Type":"ContainerStarted","Data":"f7449e8efce8148bd9dc78a27211af01ced4206e1cad326ec175038b5357a453"} Jul 18 00:48:12.966035 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:12.965631 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:12.989431 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:12.989372 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" podStartSLOduration=1.5712748749999998 podStartE2EDuration="5.989353496s" totalImagesPullingTime="3.273169619s" totalInitContainerRuntime="1.144909002s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:12.986390532 +0000 UTC m=+471.521273515" watchObservedRunningTime="2026-07-18 00:48:12.989353496 +0000 UTC m=+471.524236484" Jul 18 00:48:23.973244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:23.973210 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-jt6th" Jul 18 00:48:24.695747 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.695710 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b"] Jul 18 00:48:24.704366 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.704335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.708440 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.708408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5rzbw\"" Jul 18 00:48:24.708607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.708408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 00:48:24.708607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.708501 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 00:48:24.708607 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.708549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 00:48:24.714814 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.714768 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b"] Jul 18 00:48:24.794838 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.794786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.795037 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.794857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/495c52f5-7477-4f6d-b252-b28b8fa246dd-manager-config\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.795037 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.794898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srl7\" (UniqueName: \"kubernetes.io/projected/495c52f5-7477-4f6d-b252-b28b8fa246dd-kube-api-access-2srl7\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.795037 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.794957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-metrics-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.895938 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.895897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-metrics-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.896161 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.895973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.896161 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.896014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/495c52f5-7477-4f6d-b252-b28b8fa246dd-manager-config\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.896161 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.896040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srl7\" (UniqueName: \"kubernetes.io/projected/495c52f5-7477-4f6d-b252-b28b8fa246dd-kube-api-access-2srl7\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.896765 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.896742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/495c52f5-7477-4f6d-b252-b28b8fa246dd-manager-config\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.898842 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.898811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-metrics-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.898942 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.898817 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/495c52f5-7477-4f6d-b252-b28b8fa246dd-cert\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:24.907116 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:24.907079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srl7\" (UniqueName: \"kubernetes.io/projected/495c52f5-7477-4f6d-b252-b28b8fa246dd-kube-api-access-2srl7\") pod \"lws-controller-manager-fb6694444-s5q2b\" (UID: \"495c52f5-7477-4f6d-b252-b28b8fa246dd\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:25.013611 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:25.013505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:25.155254 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:25.155224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b"] Jul 18 00:48:25.158077 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:48:25.158045 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495c52f5_7477_4f6d_b252_b28b8fa246dd.slice/crio-42fe64a88ae24d97c5aa5a5e9bed14e8e28174de9197d327f0639b9c88d5fec0 WatchSource:0}: Error finding container 42fe64a88ae24d97c5aa5a5e9bed14e8e28174de9197d327f0639b9c88d5fec0: Status 404 returned error can't find the container with id 42fe64a88ae24d97c5aa5a5e9bed14e8e28174de9197d327f0639b9c88d5fec0 Jul 18 00:48:26.032892 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:26.032858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" event={"ID":"495c52f5-7477-4f6d-b252-b28b8fa246dd","Type":"ContainerStarted","Data":"42fe64a88ae24d97c5aa5a5e9bed14e8e28174de9197d327f0639b9c88d5fec0"} Jul 18 00:48:27.039592 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:27.039560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" event={"ID":"495c52f5-7477-4f6d-b252-b28b8fa246dd","Type":"ContainerStarted","Data":"b51e3a55d6beeac816bf16aee46dc8e456ee0c4069317974369607fc1b283bfe"} Jul 18 00:48:27.040023 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:27.039742 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:27.077203 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:27.077124 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" podStartSLOduration=1.699789132 podStartE2EDuration="3.07710583s" totalImagesPullingTime="1.377316698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:27.076838949 +0000 UTC m=+485.611721936" watchObservedRunningTime="2026-07-18 00:48:27.07710583 +0000 UTC m=+485.611988817" Jul 18 00:48:36.975177 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.975137 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-bfjs9"] Jul 18 00:48:36.979057 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.979031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:36.983647 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.983621 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 00:48:36.983907 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.983891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 18 00:48:36.984006 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.983957 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 00:48:36.985061 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.985041 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 18 00:48:36.985181 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.985046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7rmj\"" Jul 18 00:48:36.996380 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:36.996352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-bfjs9"] Jul 18 00:48:37.101450 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.101403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.101450 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.101452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf81154f-53ab-4393-9c32-68bc474332bd-tmp\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.101698 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.101507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtbrz\" (UniqueName: \"kubernetes.io/projected/cf81154f-53ab-4393-9c32-68bc474332bd-kube-api-access-qtbrz\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.202726 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.202679 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.202726 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.202725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf81154f-53ab-4393-9c32-68bc474332bd-tmp\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.202988 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:48:37.202830 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 18 00:48:37.202988 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.202870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtbrz\" (UniqueName: \"kubernetes.io/projected/cf81154f-53ab-4393-9c32-68bc474332bd-kube-api-access-qtbrz\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.202988 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:48:37.202914 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs podName:cf81154f-53ab-4393-9c32-68bc474332bd nodeName:}" failed. No retries permitted until 2026-07-18 00:48:37.702891015 +0000 UTC m=+496.237773995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs") pod "kube-auth-proxy-54498b876f-bfjs9" (UID: "cf81154f-53ab-4393-9c32-68bc474332bd") : secret "kube-auth-proxy-tls" not found Jul 18 00:48:37.205353 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.205322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf81154f-53ab-4393-9c32-68bc474332bd-tmp\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.220963 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.220929 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtbrz\" (UniqueName: \"kubernetes.io/projected/cf81154f-53ab-4393-9c32-68bc474332bd-kube-api-access-qtbrz\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.708790 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.708737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.711394 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.711359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf81154f-53ab-4393-9c32-68bc474332bd-tls-certs\") pod \"kube-auth-proxy-54498b876f-bfjs9\" (UID: \"cf81154f-53ab-4393-9c32-68bc474332bd\") " pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:37.892624 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:37.892583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" Jul 18 00:48:38.040156 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:38.040113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54498b876f-bfjs9"] Jul 18 00:48:38.042457 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:48:38.042414 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf81154f_53ab_4393_9c32_68bc474332bd.slice/crio-6dce7fd881f51446c08ab9cd56080c58c927c14c6ff3d01ede0a907ee08d572e WatchSource:0}: Error finding container 6dce7fd881f51446c08ab9cd56080c58c927c14c6ff3d01ede0a907ee08d572e: Status 404 returned error can't find the container with id 6dce7fd881f51446c08ab9cd56080c58c927c14c6ff3d01ede0a907ee08d572e Jul 18 00:48:38.047444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:38.047416 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fb6694444-s5q2b" Jul 18 00:48:38.093325 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:38.093284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" event={"ID":"cf81154f-53ab-4393-9c32-68bc474332bd","Type":"ContainerStarted","Data":"6dce7fd881f51446c08ab9cd56080c58c927c14c6ff3d01ede0a907ee08d572e"} Jul 18 00:48:41.110741 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:41.110703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" event={"ID":"cf81154f-53ab-4393-9c32-68bc474332bd","Type":"ContainerStarted","Data":"84a13bb70e790517c497e949d964713a03ebd5371669130b8d542c00dac90f59"} Jul 18 00:48:41.129772 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:48:41.129714 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54498b876f-bfjs9" podStartSLOduration=2.6711108489999997 podStartE2EDuration="5.129695348s" totalImagesPullingTime="2.458584499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:41.128540404 +0000 UTC m=+499.663423391" watchObservedRunningTime="2026-07-18 00:48:41.129695348 +0000 UTC m=+499.664578329" Jul 18 00:49:43.240401 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.240364 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9"] Jul 18 00:49:43.243827 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.243812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.246505 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.246459 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 00:49:43.246505 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.246473 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 00:49:43.247701 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.247683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kmxzj\"" Jul 18 00:49:43.252254 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.252225 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9"] Jul 18 00:49:43.291147 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.291116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.291325 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.291162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtrz\" (UniqueName: \"kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.291325 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.291184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.391837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.391797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtrz\" (UniqueName: \"kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.391837 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.391838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.392040 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.391910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.392263 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.392246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.392306 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.392270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.399931 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.399899 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtrz\" (UniqueName: \"kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.554927 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.554891 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:43.698530 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:43.698499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9"] Jul 18 00:49:43.700337 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:49:43.700295 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b5e77f_9afd_4202_8429_52c2a652aad6.slice/crio-f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21 WatchSource:0}: Error finding container f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21: Status 404 returned error can't find the container with id f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21 Jul 18 00:49:44.040640 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.040600 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg"] Jul 18 00:49:44.044229 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.044207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.055874 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.055845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg"] Jul 18 00:49:44.098227 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.098133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.098227 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.098219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.098432 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.098251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x89tz\" (UniqueName: \"kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.199370 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.199325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.199652 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.199439 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.199652 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.199467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x89tz\" (UniqueName: \"kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.199788 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.199733 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.199841 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.199787 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.210633 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.210600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x89tz\" (UniqueName: \"kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.353631 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.353539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:44.424307 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.424272 2577 generic.go:356] "Generic (PLEG): container finished" podID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerID="29014767b34f4fe21636bb60a4d1c9687c0b24ddba35d518d2cd23489f1de9f1" exitCode=0 Jul 18 00:49:44.424517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.424363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" event={"ID":"51b5e77f-9afd-4202-8429-52c2a652aad6","Type":"ContainerDied","Data":"29014767b34f4fe21636bb60a4d1c9687c0b24ddba35d518d2cd23489f1de9f1"} Jul 18 00:49:44.424517 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.424412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" event={"ID":"51b5e77f-9afd-4202-8429-52c2a652aad6","Type":"ContainerStarted","Data":"f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21"} Jul 18 00:49:44.443202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.443096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b"] Jul 18 00:49:44.449054 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.449025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.454438 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.454402 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b"] Jul 18 00:49:44.502427 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.502407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7wr\" (UniqueName: \"kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.502544 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.502528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.502602 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.502535 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg"] Jul 18 00:49:44.502602 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.502560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.504882 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:49:44.504845 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77411d0d_89bf_49cd_9bf3_1118a825593d.slice/crio-5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c WatchSource:0}: Error finding container 5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c: Status 404 returned error can't find the container with id 5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c Jul 18 00:49:44.603011 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.602968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7wr\" (UniqueName: \"kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.603183 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.603037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.603183 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.603063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.603521 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.603466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.603567 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.603479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.611784 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.611759 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7wr\" (UniqueName: \"kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.762097 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.762061 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:44.841410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.841367 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt"] Jul 18 00:49:44.845370 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.845341 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:44.853246 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.853217 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt"] Jul 18 00:49:44.906205 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.906115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:44.906205 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.906182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:44.906397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.906240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc8m7\" (UniqueName: \"kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:44.915987 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:44.915957 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b"] Jul 18 00:49:44.917790 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:49:44.917764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d17b16_8f58_488e_a404_2d70001066d5.slice/crio-599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e WatchSource:0}: Error finding container 599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e: Status 404 returned error can't find the container with id 599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e Jul 18 00:49:45.007110 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.007063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.007326 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.007137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.007326 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.007191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8m7\" (UniqueName: \"kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.007564 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.007543 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.007636 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.007567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.016627 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.016600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc8m7\" (UniqueName: \"kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.158609 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.158455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:45.306192 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.306159 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt"] Jul 18 00:49:45.307893 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:49:45.307867 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae67d92_bef5_4dce_aedf_ed6d5c8130af.slice/crio-293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4 WatchSource:0}: Error finding container 293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4: Status 404 returned error can't find the container with id 293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4 Jul 18 00:49:45.432679 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.432644 2577 generic.go:356] "Generic (PLEG): container finished" podID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerID="22ccf090db0062be635c9937b1c98108e3d57fd34febaedf3a39241441cad4af" exitCode=0 Jul 18 00:49:45.433150 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.432724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" event={"ID":"51b5e77f-9afd-4202-8429-52c2a652aad6","Type":"ContainerDied","Data":"22ccf090db0062be635c9937b1c98108e3d57fd34febaedf3a39241441cad4af"} Jul 18 00:49:45.434323 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.434295 2577 generic.go:356] "Generic (PLEG): container finished" podID="83d17b16-8f58-488e-a404-2d70001066d5" containerID="3087f43070a966d037afaad2304af3149518a1574c3f5a39ef396bc330ea32de" exitCode=0 Jul 18 00:49:45.434428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.434382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" event={"ID":"83d17b16-8f58-488e-a404-2d70001066d5","Type":"ContainerDied","Data":"3087f43070a966d037afaad2304af3149518a1574c3f5a39ef396bc330ea32de"} Jul 18 00:49:45.434428 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.434421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" event={"ID":"83d17b16-8f58-488e-a404-2d70001066d5","Type":"ContainerStarted","Data":"599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e"} Jul 18 00:49:45.436125 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.436089 2577 generic.go:356] "Generic (PLEG): container finished" podID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerID="9ac60d082f32db1c9eff0969f513655b90f683df0fd320d6144b159d6ce20538" exitCode=0 Jul 18 00:49:45.436216 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.436187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" event={"ID":"9ae67d92-bef5-4dce-aedf-ed6d5c8130af","Type":"ContainerDied","Data":"9ac60d082f32db1c9eff0969f513655b90f683df0fd320d6144b159d6ce20538"} Jul 18 00:49:45.436286 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.436242 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" event={"ID":"9ae67d92-bef5-4dce-aedf-ed6d5c8130af","Type":"ContainerStarted","Data":"293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4"} Jul 18 00:49:45.437873 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.437849 2577 generic.go:356] "Generic (PLEG): container finished" podID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerID="bfef1ffea8f8d95b68f9c8cfe3f4f1f6bb720e4ceb415e66b830f85f2630f276" exitCode=0 Jul 18 00:49:45.437992 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.437875 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" event={"ID":"77411d0d-89bf-49cd-9bf3-1118a825593d","Type":"ContainerDied","Data":"bfef1ffea8f8d95b68f9c8cfe3f4f1f6bb720e4ceb415e66b830f85f2630f276"} Jul 18 00:49:45.437992 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:45.437922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" event={"ID":"77411d0d-89bf-49cd-9bf3-1118a825593d","Type":"ContainerStarted","Data":"5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c"} Jul 18 00:49:46.447439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:46.447281 2577 generic.go:356] "Generic (PLEG): container finished" podID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerID="85bd7dbf35d4854db2e87037d97aef294b1d483b03b1435a7f969b82bc45f7e8" exitCode=0 Jul 18 00:49:46.447439 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:46.447363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" event={"ID":"51b5e77f-9afd-4202-8429-52c2a652aad6","Type":"ContainerDied","Data":"85bd7dbf35d4854db2e87037d97aef294b1d483b03b1435a7f969b82bc45f7e8"} Jul 18 00:49:46.449797 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:46.449771 2577 generic.go:356] "Generic (PLEG): container finished" podID="83d17b16-8f58-488e-a404-2d70001066d5" containerID="ba711dd212973576f62fa6eff6193121216c7860b11f3603532ae55a68f030ce" exitCode=0 Jul 18 00:49:46.449900 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:46.449843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" event={"ID":"83d17b16-8f58-488e-a404-2d70001066d5","Type":"ContainerDied","Data":"ba711dd212973576f62fa6eff6193121216c7860b11f3603532ae55a68f030ce"} Jul 18 00:49:47.457087 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.457050 2577 generic.go:356] "Generic (PLEG): container finished" podID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerID="46954fa741e489c5895b25351dbe38bcc1661eba682247bf2c5d76b0e3fdf080" exitCode=0 Jul 18 00:49:47.457562 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.457143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" event={"ID":"9ae67d92-bef5-4dce-aedf-ed6d5c8130af","Type":"ContainerDied","Data":"46954fa741e489c5895b25351dbe38bcc1661eba682247bf2c5d76b0e3fdf080"} Jul 18 00:49:47.459076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.459052 2577 generic.go:356] "Generic (PLEG): container finished" podID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerID="f3287aab79a3e4b5cb35ebc17c34493a6da3283a4211c756607c48c5e2e81061" exitCode=0 Jul 18 00:49:47.459220 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.459192 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" event={"ID":"77411d0d-89bf-49cd-9bf3-1118a825593d","Type":"ContainerDied","Data":"f3287aab79a3e4b5cb35ebc17c34493a6da3283a4211c756607c48c5e2e81061"} Jul 18 00:49:47.461608 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.461582 2577 generic.go:356] "Generic (PLEG): container finished" podID="83d17b16-8f58-488e-a404-2d70001066d5" containerID="653d2294845536c0ae103230c57a5578269ecf3d874fdf0253aa6327b246d09c" exitCode=0 Jul 18 00:49:47.461731 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.461665 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" event={"ID":"83d17b16-8f58-488e-a404-2d70001066d5","Type":"ContainerDied","Data":"653d2294845536c0ae103230c57a5578269ecf3d874fdf0253aa6327b246d09c"} Jul 18 00:49:47.615232 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.615199 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:47.632225 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.632193 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util\") pod \"51b5e77f-9afd-4202-8429-52c2a652aad6\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " Jul 18 00:49:47.632365 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.632263 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle\") pod \"51b5e77f-9afd-4202-8429-52c2a652aad6\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " Jul 18 00:49:47.632365 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.632289 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbtrz\" (UniqueName: \"kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz\") pod \"51b5e77f-9afd-4202-8429-52c2a652aad6\" (UID: \"51b5e77f-9afd-4202-8429-52c2a652aad6\") " Jul 18 00:49:47.632822 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.632745 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle" (OuterVolumeSpecName: "bundle") pod "51b5e77f-9afd-4202-8429-52c2a652aad6" (UID: "51b5e77f-9afd-4202-8429-52c2a652aad6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:47.635181 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.635146 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz" (OuterVolumeSpecName: "kube-api-access-pbtrz") pod "51b5e77f-9afd-4202-8429-52c2a652aad6" (UID: "51b5e77f-9afd-4202-8429-52c2a652aad6"). InnerVolumeSpecName "kube-api-access-pbtrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:49:47.639580 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.639537 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util" (OuterVolumeSpecName: "util") pod "51b5e77f-9afd-4202-8429-52c2a652aad6" (UID: "51b5e77f-9afd-4202-8429-52c2a652aad6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:47.733965 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.733926 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:47.733965 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.733957 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b5e77f-9afd-4202-8429-52c2a652aad6-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:47.733965 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:47.733967 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbtrz\" (UniqueName: \"kubernetes.io/projected/51b5e77f-9afd-4202-8429-52c2a652aad6-kube-api-access-pbtrz\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:48.469339 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.469298 2577 generic.go:356] "Generic (PLEG): container finished" podID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerID="b5d01cd9fb7c099737571fd89fa0dee2344d8be125ba1abe452fac0926a5026d" exitCode=0 Jul 18 00:49:48.469773 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.469386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" event={"ID":"77411d0d-89bf-49cd-9bf3-1118a825593d","Type":"ContainerDied","Data":"b5d01cd9fb7c099737571fd89fa0dee2344d8be125ba1abe452fac0926a5026d"} Jul 18 00:49:48.471533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.471512 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" Jul 18 00:49:48.471533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.471522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9" event={"ID":"51b5e77f-9afd-4202-8429-52c2a652aad6","Type":"ContainerDied","Data":"f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21"} Jul 18 00:49:48.471738 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.471566 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5d5bf03e71d6e1a0138714f3bdd4d12f550320b5c3568d11f6c5425b9606b21" Jul 18 00:49:48.474120 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.474087 2577 generic.go:356] "Generic (PLEG): container finished" podID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerID="00da7680718e5f4c891dab7430afa4a03633eb0ed648d6f5f3d5e9cc0dbe127c" exitCode=0 Jul 18 00:49:48.474289 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.474161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" event={"ID":"9ae67d92-bef5-4dce-aedf-ed6d5c8130af","Type":"ContainerDied","Data":"00da7680718e5f4c891dab7430afa4a03633eb0ed648d6f5f3d5e9cc0dbe127c"} Jul 18 00:49:48.618699 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.618658 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:48.641540 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.641503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd7wr\" (UniqueName: \"kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr\") pod \"83d17b16-8f58-488e-a404-2d70001066d5\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " Jul 18 00:49:48.641747 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.641576 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util\") pod \"83d17b16-8f58-488e-a404-2d70001066d5\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " Jul 18 00:49:48.641747 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.641628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle\") pod \"83d17b16-8f58-488e-a404-2d70001066d5\" (UID: \"83d17b16-8f58-488e-a404-2d70001066d5\") " Jul 18 00:49:48.643326 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.642604 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle" (OuterVolumeSpecName: "bundle") pod "83d17b16-8f58-488e-a404-2d70001066d5" (UID: "83d17b16-8f58-488e-a404-2d70001066d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:48.644850 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.644816 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr" (OuterVolumeSpecName: "kube-api-access-bd7wr") pod "83d17b16-8f58-488e-a404-2d70001066d5" (UID: "83d17b16-8f58-488e-a404-2d70001066d5"). InnerVolumeSpecName "kube-api-access-bd7wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:49:48.648334 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.648294 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util" (OuterVolumeSpecName: "util") pod "83d17b16-8f58-488e-a404-2d70001066d5" (UID: "83d17b16-8f58-488e-a404-2d70001066d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:48.742838 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.742741 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd7wr\" (UniqueName: \"kubernetes.io/projected/83d17b16-8f58-488e-a404-2d70001066d5-kube-api-access-bd7wr\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:48.742838 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.742773 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:48.742838 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:48.742784 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d17b16-8f58-488e-a404-2d70001066d5-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.480967 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.480934 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" Jul 18 00:49:49.480967 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.480955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b" event={"ID":"83d17b16-8f58-488e-a404-2d70001066d5","Type":"ContainerDied","Data":"599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e"} Jul 18 00:49:49.481562 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.481005 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="599f4e61c31d719505b01230a5ff2e4c9f13f8c856a0bbc7aa1b78371c09f03e" Jul 18 00:49:49.649947 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.649912 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:49.654364 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.654331 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:49:49.751658 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751569 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util\") pod \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " Jul 18 00:49:49.751658 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util\") pod \"77411d0d-89bf-49cd-9bf3-1118a825593d\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " Jul 18 00:49:49.751658 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751654 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x89tz\" (UniqueName: \"kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz\") pod \"77411d0d-89bf-49cd-9bf3-1118a825593d\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " Jul 18 00:49:49.751959 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751685 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle\") pod \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " Jul 18 00:49:49.751959 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751711 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle\") pod \"77411d0d-89bf-49cd-9bf3-1118a825593d\" (UID: \"77411d0d-89bf-49cd-9bf3-1118a825593d\") " Jul 18 00:49:49.751959 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.751744 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc8m7\" (UniqueName: \"kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7\") pod \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\" (UID: \"9ae67d92-bef5-4dce-aedf-ed6d5c8130af\") " Jul 18 00:49:49.752200 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.752170 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle" (OuterVolumeSpecName: "bundle") pod "9ae67d92-bef5-4dce-aedf-ed6d5c8130af" (UID: "9ae67d92-bef5-4dce-aedf-ed6d5c8130af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:49.752339 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.752314 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle" (OuterVolumeSpecName: "bundle") pod "77411d0d-89bf-49cd-9bf3-1118a825593d" (UID: "77411d0d-89bf-49cd-9bf3-1118a825593d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:49.754173 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.754141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7" (OuterVolumeSpecName: "kube-api-access-pc8m7") pod "9ae67d92-bef5-4dce-aedf-ed6d5c8130af" (UID: "9ae67d92-bef5-4dce-aedf-ed6d5c8130af"). InnerVolumeSpecName "kube-api-access-pc8m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:49:49.754279 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.754211 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz" (OuterVolumeSpecName: "kube-api-access-x89tz") pod "77411d0d-89bf-49cd-9bf3-1118a825593d" (UID: "77411d0d-89bf-49cd-9bf3-1118a825593d"). InnerVolumeSpecName "kube-api-access-x89tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:49:49.757374 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.757351 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util" (OuterVolumeSpecName: "util") pod "9ae67d92-bef5-4dce-aedf-ed6d5c8130af" (UID: "9ae67d92-bef5-4dce-aedf-ed6d5c8130af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:49.770853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.770813 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util" (OuterVolumeSpecName: "util") pod "77411d0d-89bf-49cd-9bf3-1118a825593d" (UID: "77411d0d-89bf-49cd-9bf3-1118a825593d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:49:49.853076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853029 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.853076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853065 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.853076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853075 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc8m7\" (UniqueName: \"kubernetes.io/projected/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-kube-api-access-pc8m7\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.853076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853088 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ae67d92-bef5-4dce-aedf-ed6d5c8130af-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.853401 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853099 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77411d0d-89bf-49cd-9bf3-1118a825593d-util\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:49.853401 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:49.853107 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x89tz\" (UniqueName: \"kubernetes.io/projected/77411d0d-89bf-49cd-9bf3-1118a825593d-kube-api-access-x89tz\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:49:50.488735 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.488707 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" Jul 18 00:49:50.489201 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.488706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt" event={"ID":"9ae67d92-bef5-4dce-aedf-ed6d5c8130af","Type":"ContainerDied","Data":"293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4"} Jul 18 00:49:50.489201 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.488851 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="293e87e2662d7c44fd0ae6f0d1a0ddd4bb1f10556ac3733babeaa916196073e4" Jul 18 00:49:50.490899 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.490862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" event={"ID":"77411d0d-89bf-49cd-9bf3-1118a825593d","Type":"ContainerDied","Data":"5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c"} Jul 18 00:49:50.491060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.490919 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5920b78c371fc375677aa787df7be5553810604c92e503031aca24a0f5083c2c" Jul 18 00:49:50.491060 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:49:50.490871 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg" Jul 18 00:50:14.071351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071304 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph"] Jul 18 00:50:14.071892 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071874 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="extract" Jul 18 00:50:14.071941 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071897 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="extract" Jul 18 00:50:14.071941 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071913 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="pull" Jul 18 00:50:14.071941 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071922 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="pull" Jul 18 00:50:14.071941 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071937 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="util" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.071945 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="util" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072016 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="pull" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072024 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="pull" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072035 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="extract" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072045 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="extract" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072064 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="util" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072073 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="util" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072088 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="pull" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072097 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="pull" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072106 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="pull" Jul 18 00:50:14.072117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072116 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="pull" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072128 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072137 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072149 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="util" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072199 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="util" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072223 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="util" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072237 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="util" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072246 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072254 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072351 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="77411d0d-89bf-49cd-9bf3-1118a825593d" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072364 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d17b16-8f58-488e-a404-2d70001066d5" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072377 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b5e77f-9afd-4202-8429-52c2a652aad6" containerName="extract" Jul 18 00:50:14.072522 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.072389 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae67d92-bef5-4dce-aedf-ed6d5c8130af" containerName="extract" Jul 18 00:50:14.075791 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.075762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.078674 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.078644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kmxzj\"" Jul 18 00:50:14.078855 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.078669 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 18 00:50:14.079946 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.079919 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 18 00:50:14.080101 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.079954 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 00:50:14.080101 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.079924 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 00:50:14.087626 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.087595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph"] Jul 18 00:50:14.178917 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.178873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w8gr\" (UniqueName: \"kubernetes.io/projected/d0f1d80e-05c2-40d4-854a-8ab86da189b0-kube-api-access-5w8gr\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.179129 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.178947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.179129 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.179041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0f1d80e-05c2-40d4-854a-8ab86da189b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.279547 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.279467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w8gr\" (UniqueName: \"kubernetes.io/projected/d0f1d80e-05c2-40d4-854a-8ab86da189b0-kube-api-access-5w8gr\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.279826 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.279600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.279826 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.279644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0f1d80e-05c2-40d4-854a-8ab86da189b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.279826 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:50:14.279759 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 18 00:50:14.279955 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:50:14.279859 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert podName:d0f1d80e-05c2-40d4-854a-8ab86da189b0 nodeName:}" failed. No retries permitted until 2026-07-18 00:50:14.779832942 +0000 UTC m=+593.314715923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-dmhph" (UID: "d0f1d80e-05c2-40d4-854a-8ab86da189b0") : secret "plugin-serving-cert" not found Jul 18 00:50:14.280250 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.280232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d0f1d80e-05c2-40d4-854a-8ab86da189b0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.289810 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.289775 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w8gr\" (UniqueName: \"kubernetes.io/projected/d0f1d80e-05c2-40d4-854a-8ab86da189b0-kube-api-access-5w8gr\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.784887 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.784848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.787539 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.787479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0f1d80e-05c2-40d4-854a-8ab86da189b0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-dmhph\" (UID: \"d0f1d80e-05c2-40d4-854a-8ab86da189b0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:14.988350 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:14.988303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" Jul 18 00:50:15.153087 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:15.153062 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph"] Jul 18 00:50:15.155585 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:50:15.155549 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f1d80e_05c2_40d4_854a_8ab86da189b0.slice/crio-a8d04569567704ca92fcc619e15aae4a9209a26fa9ba5699e2d1ef63427ef965 WatchSource:0}: Error finding container a8d04569567704ca92fcc619e15aae4a9209a26fa9ba5699e2d1ef63427ef965: Status 404 returned error can't find the container with id a8d04569567704ca92fcc619e15aae4a9209a26fa9ba5699e2d1ef63427ef965 Jul 18 00:50:15.625684 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:15.625645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" event={"ID":"d0f1d80e-05c2-40d4-854a-8ab86da189b0","Type":"ContainerStarted","Data":"a8d04569567704ca92fcc619e15aae4a9209a26fa9ba5699e2d1ef63427ef965"} Jul 18 00:50:29.454327 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.453302 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56d77cb5cf-25z54"] Jul 18 00:50:29.521357 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.521312 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d77cb5cf-25z54"] Jul 18 00:50:29.521603 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.521531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642421 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-oauth-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642702 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-oauth-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642795 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqj9\" (UniqueName: \"kubernetes.io/projected/4ee5155d-985f-44c7-97b2-9577492bad6d-kube-api-access-9qqj9\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-service-ca\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-console-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.642953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.642937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-trusted-ca-bundle\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-console-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-trusted-ca-bundle\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-oauth-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-oauth-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqj9\" (UniqueName: \"kubernetes.io/projected/4ee5155d-985f-44c7-97b2-9577492bad6d-kube-api-access-9qqj9\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-service-ca\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.744614 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.745015 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.744963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-console-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.745205 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.745178 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-trusted-ca-bundle\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.745474 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.745451 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-oauth-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.745686 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.745663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee5155d-985f-44c7-97b2-9577492bad6d-service-ca\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.748114 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.747953 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-serving-cert\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.748259 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.748144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ee5155d-985f-44c7-97b2-9577492bad6d-console-oauth-config\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.754286 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.754254 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqj9\" (UniqueName: \"kubernetes.io/projected/4ee5155d-985f-44c7-97b2-9577492bad6d-kube-api-access-9qqj9\") pod \"console-56d77cb5cf-25z54\" (UID: \"4ee5155d-985f-44c7-97b2-9577492bad6d\") " pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:29.833660 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:29.833621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:37.157248 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.157212 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:50:37.157780 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.157658 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:50:37.291103 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.291067 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56d77cb5cf-25z54"] Jul 18 00:50:37.293531 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:50:37.293471 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee5155d_985f_44c7_97b2_9577492bad6d.slice/crio-b8e767039527730d45ba1616076816b1de16d87d655a4129d409e8cab2ffdccd WatchSource:0}: Error finding container b8e767039527730d45ba1616076816b1de16d87d655a4129d409e8cab2ffdccd: Status 404 returned error can't find the container with id b8e767039527730d45ba1616076816b1de16d87d655a4129d409e8cab2ffdccd Jul 18 00:50:37.779319 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.779278 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d77cb5cf-25z54" event={"ID":"4ee5155d-985f-44c7-97b2-9577492bad6d","Type":"ContainerStarted","Data":"922c74aba9315628259d60a03123c502ae680370b79779a1b54ba8a2979039cb"} Jul 18 00:50:37.779547 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.779343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56d77cb5cf-25z54" event={"ID":"4ee5155d-985f-44c7-97b2-9577492bad6d","Type":"ContainerStarted","Data":"b8e767039527730d45ba1616076816b1de16d87d655a4129d409e8cab2ffdccd"} Jul 18 00:50:37.780973 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.780943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" event={"ID":"d0f1d80e-05c2-40d4-854a-8ab86da189b0","Type":"ContainerStarted","Data":"ec4c99ef05498e8b27b86a6bd52f9b836d8a66c3ac5568c7a42ef04394a62cd8"} Jul 18 00:50:37.843372 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.843305 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56d77cb5cf-25z54" podStartSLOduration=8.843285837 podStartE2EDuration="8.843285837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:37.840282269 +0000 UTC m=+616.375165317" watchObservedRunningTime="2026-07-18 00:50:37.843285837 +0000 UTC m=+616.378168823" Jul 18 00:50:37.882270 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:37.882199 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-dmhph" podStartSLOduration=1.823457401 podStartE2EDuration="23.882178159s" totalImagesPullingTime="22.058720758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:37.881630548 +0000 UTC m=+616.416513536" watchObservedRunningTime="2026-07-18 00:50:37.882178159 +0000 UTC m=+616.417061147" Jul 18 00:50:39.833889 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:39.833848 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:39.834316 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:39.833944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:39.839059 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:39.839021 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:40.802776 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:40.802744 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56d77cb5cf-25z54" Jul 18 00:50:40.874248 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:40.874204 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:50:54.401803 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.401702 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:50:54.422117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.422085 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:50:54.422290 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.422207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.425513 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.425443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 00:50:54.491105 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.491070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.491258 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.491117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z4qn\" (UniqueName: \"kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.498745 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.498710 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:50:54.592556 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.592510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.592746 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.592568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4qn\" (UniqueName: \"kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.593186 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.593163 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.603158 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.603116 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z4qn\" (UniqueName: \"kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn\") pod \"limitador-limitador-64c94fd64f-nwk5t\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.734346 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.734245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:50:54.885249 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:54.885119 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:50:54.887985 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:50:54.887952 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3103a6f_546f_4f65_a35e_1078e59dbd33.slice/crio-2b6786bcea0fbacdc24b2fefdff5ad72ce7afb1f9b5f4f686c91f2d48b0c7273 WatchSource:0}: Error finding container 2b6786bcea0fbacdc24b2fefdff5ad72ce7afb1f9b5f4f686c91f2d48b0c7273: Status 404 returned error can't find the container with id 2b6786bcea0fbacdc24b2fefdff5ad72ce7afb1f9b5f4f686c91f2d48b0c7273 Jul 18 00:50:55.206604 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.206561 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:50:55.211602 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.211567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:50:55.214628 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.214599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wqhl\"" Jul 18 00:50:55.218618 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.218587 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:50:55.299036 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.298975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zp7\" (UniqueName: \"kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7\") pod \"authorino-58cd955675-rjqxt\" (UID: \"88fc218b-871a-42e8-a554-5897d02b1794\") " pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:50:55.400724 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.400683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zp7\" (UniqueName: \"kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7\") pod \"authorino-58cd955675-rjqxt\" (UID: \"88fc218b-871a-42e8-a554-5897d02b1794\") " pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:50:55.414592 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.414561 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zp7\" (UniqueName: \"kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7\") pod \"authorino-58cd955675-rjqxt\" (UID: \"88fc218b-871a-42e8-a554-5897d02b1794\") " pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:50:55.523117 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.523024 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:50:55.725189 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.724942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:50:55.732111 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:50:55.732070 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88fc218b_871a_42e8_a554_5897d02b1794.slice/crio-409daf7e1844e0282961882d9748a50f8b570ec2ae2c42e000679c7a38354055 WatchSource:0}: Error finding container 409daf7e1844e0282961882d9748a50f8b570ec2ae2c42e000679c7a38354055: Status 404 returned error can't find the container with id 409daf7e1844e0282961882d9748a50f8b570ec2ae2c42e000679c7a38354055 Jul 18 00:50:55.884712 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.884663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjqxt" event={"ID":"88fc218b-871a-42e8-a554-5897d02b1794","Type":"ContainerStarted","Data":"409daf7e1844e0282961882d9748a50f8b570ec2ae2c42e000679c7a38354055"} Jul 18 00:50:55.886937 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:50:55.886797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" event={"ID":"d3103a6f-546f-4f65-a35e-1078e59dbd33","Type":"ContainerStarted","Data":"2b6786bcea0fbacdc24b2fefdff5ad72ce7afb1f9b5f4f686c91f2d48b0c7273"} Jul 18 00:51:00.367774 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.367736 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:51:00.927124 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.927030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjqxt" event={"ID":"88fc218b-871a-42e8-a554-5897d02b1794","Type":"ContainerStarted","Data":"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664"} Jul 18 00:51:00.927124 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.927074 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rjqxt" podUID="88fc218b-871a-42e8-a554-5897d02b1794" containerName="authorino" containerID="cri-o://6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664" gracePeriod=30 Jul 18 00:51:00.928870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.928840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" event={"ID":"d3103a6f-546f-4f65-a35e-1078e59dbd33","Type":"ContainerStarted","Data":"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac"} Jul 18 00:51:00.929034 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.928910 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:51:00.944629 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.944566 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rjqxt" podStartSLOduration=1.012042721 podStartE2EDuration="5.944543323s" totalImagesPullingTime="4.932500602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:00.943174252 +0000 UTC m=+639.478057256" watchObservedRunningTime="2026-07-18 00:51:00.944543323 +0000 UTC m=+639.479426311" Jul 18 00:51:00.972007 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:00.971942 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" podStartSLOduration=1.2064445 podStartE2EDuration="6.971922448s" totalImagesPullingTime="5.765477948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:00.970657715 +0000 UTC m=+639.505540704" watchObservedRunningTime="2026-07-18 00:51:00.971922448 +0000 UTC m=+639.506805434" Jul 18 00:51:01.215046 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.215011 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:51:01.259239 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.259200 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8zp7\" (UniqueName: \"kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7\") pod \"88fc218b-871a-42e8-a554-5897d02b1794\" (UID: \"88fc218b-871a-42e8-a554-5897d02b1794\") " Jul 18 00:51:01.261465 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.261432 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7" (OuterVolumeSpecName: "kube-api-access-p8zp7") pod "88fc218b-871a-42e8-a554-5897d02b1794" (UID: "88fc218b-871a-42e8-a554-5897d02b1794"). InnerVolumeSpecName "kube-api-access-p8zp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:01.360226 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.360187 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8zp7\" (UniqueName: \"kubernetes.io/projected/88fc218b-871a-42e8-a554-5897d02b1794-kube-api-access-p8zp7\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:01.935719 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.935682 2577 generic.go:356] "Generic (PLEG): container finished" podID="88fc218b-871a-42e8-a554-5897d02b1794" containerID="6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664" exitCode=0 Jul 18 00:51:01.936135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.935746 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rjqxt" Jul 18 00:51:01.936135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.935766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjqxt" event={"ID":"88fc218b-871a-42e8-a554-5897d02b1794","Type":"ContainerDied","Data":"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664"} Jul 18 00:51:01.936135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.935820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rjqxt" event={"ID":"88fc218b-871a-42e8-a554-5897d02b1794","Type":"ContainerDied","Data":"409daf7e1844e0282961882d9748a50f8b570ec2ae2c42e000679c7a38354055"} Jul 18 00:51:01.936135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.935839 2577 scope.go:117] "RemoveContainer" containerID="6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664" Jul 18 00:51:01.946048 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.946026 2577 scope.go:117] "RemoveContainer" containerID="6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664" Jul 18 00:51:01.946363 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:51:01.946342 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664\": container with ID starting with 6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664 not found: ID does not exist" containerID="6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664" Jul 18 00:51:01.946418 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.946373 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664"} err="failed to get container status \"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664\": rpc error: code = NotFound desc = could not find container \"6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664\": container with ID starting with 6f0dddbf9e28a95ff5809dec0033ea9aad9b04ac93305aa479ead28f2e4da664 not found: ID does not exist" Jul 18 00:51:01.957948 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.957912 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:51:01.966264 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:01.966232 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rjqxt"] Jul 18 00:51:03.966076 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:03.966032 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88fc218b-871a-42e8-a554-5897d02b1794" path="/var/lib/kubelet/pods/88fc218b-871a-42e8-a554-5897d02b1794/volumes" Jul 18 00:51:05.897832 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:05.897774 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b9fdf4b7b-crvrf" podUID="808f87e5-d793-405e-a897-cf43d9b2f3ef" containerName="console" containerID="cri-o://237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5" gracePeriod=15 Jul 18 00:51:06.760479 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.760446 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:51:06.812187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812149 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812187 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812186 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812212 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812250 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812388 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812432 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812691 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812529 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc76c\" (UniqueName: \"kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c\") pod \"808f87e5-d793-405e-a897-cf43d9b2f3ef\" (UID: \"808f87e5-d793-405e-a897-cf43d9b2f3ef\") " Jul 18 00:51:06.812746 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812720 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:51:06.812794 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812739 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca" (OuterVolumeSpecName: "service-ca") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:51:06.812794 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812745 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config" (OuterVolumeSpecName: "console-config") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:51:06.813135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812872 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-service-ca\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.813135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812889 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.813135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.812901 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-trusted-ca-bundle\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.813135 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.813078 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:51:06.814747 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.814718 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:51:06.814870 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.814822 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:51:06.814942 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.814919 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c" (OuterVolumeSpecName: "kube-api-access-kc76c") pod "808f87e5-d793-405e-a897-cf43d9b2f3ef" (UID: "808f87e5-d793-405e-a897-cf43d9b2f3ef"). InnerVolumeSpecName "kube-api-access-kc76c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:06.914285 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.914193 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808f87e5-d793-405e-a897-cf43d9b2f3ef-oauth-serving-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.914285 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.914225 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-oauth-config\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.914285 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.914234 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc76c\" (UniqueName: \"kubernetes.io/projected/808f87e5-d793-405e-a897-cf43d9b2f3ef-kube-api-access-kc76c\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.914285 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.914243 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808f87e5-d793-405e-a897-cf43d9b2f3ef-console-serving-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:06.971853 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.971816 2577 generic.go:356] "Generic (PLEG): container finished" podID="808f87e5-d793-405e-a897-cf43d9b2f3ef" containerID="237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5" exitCode=0 Jul 18 00:51:06.972057 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.971868 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9fdf4b7b-crvrf" Jul 18 00:51:06.972057 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.971906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9fdf4b7b-crvrf" event={"ID":"808f87e5-d793-405e-a897-cf43d9b2f3ef","Type":"ContainerDied","Data":"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5"} Jul 18 00:51:06.972057 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.971960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9fdf4b7b-crvrf" event={"ID":"808f87e5-d793-405e-a897-cf43d9b2f3ef","Type":"ContainerDied","Data":"c1733b0814f3ed41cbf88f892c1283a636b2526ca896f6ff82e7bfb8819ede8e"} Jul 18 00:51:06.972057 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.971989 2577 scope.go:117] "RemoveContainer" containerID="237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5" Jul 18 00:51:06.982662 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.982641 2577 scope.go:117] "RemoveContainer" containerID="237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5" Jul 18 00:51:06.982978 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:51:06.982954 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5\": container with ID starting with 237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5 not found: ID does not exist" containerID="237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5" Jul 18 00:51:06.983051 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.982986 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5"} err="failed to get container status \"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5\": rpc error: code = NotFound desc = could not find container \"237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5\": container with ID starting with 237fc4771a7850bb8bd25894a2acce5d0fd5b24fc8f8383f52985476300a3ce5 not found: ID does not exist" Jul 18 00:51:06.995304 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.995273 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:51:06.997390 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:06.997367 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b9fdf4b7b-crvrf"] Jul 18 00:51:07.965840 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:07.965809 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="808f87e5-d793-405e-a897-cf43d9b2f3ef" path="/var/lib/kubelet/pods/808f87e5-d793-405e-a897-cf43d9b2f3ef/volumes" Jul 18 00:51:09.359811 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.359757 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:51:09.360390 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.360133 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" podUID="d3103a6f-546f-4f65-a35e-1078e59dbd33" containerName="limitador" containerID="cri-o://c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac" gracePeriod=30 Jul 18 00:51:09.362698 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.362672 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:51:09.920861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.920786 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:51:09.990604 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.990570 2577 generic.go:356] "Generic (PLEG): container finished" podID="d3103a6f-546f-4f65-a35e-1078e59dbd33" containerID="c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac" exitCode=0 Jul 18 00:51:09.990805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.990622 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" Jul 18 00:51:09.990805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.990661 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" event={"ID":"d3103a6f-546f-4f65-a35e-1078e59dbd33","Type":"ContainerDied","Data":"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac"} Jul 18 00:51:09.990805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.990724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nwk5t" event={"ID":"d3103a6f-546f-4f65-a35e-1078e59dbd33","Type":"ContainerDied","Data":"2b6786bcea0fbacdc24b2fefdff5ad72ce7afb1f9b5f4f686c91f2d48b0c7273"} Jul 18 00:51:09.990805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:09.990754 2577 scope.go:117] "RemoveContainer" containerID="c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac" Jul 18 00:51:10.000387 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.000362 2577 scope.go:117] "RemoveContainer" containerID="c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac" Jul 18 00:51:10.000855 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:51:10.000833 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac\": container with ID starting with c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac not found: ID does not exist" containerID="c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac" Jul 18 00:51:10.000921 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.000865 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac"} err="failed to get container status \"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac\": rpc error: code = NotFound desc = could not find container \"c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac\": container with ID starting with c1b4b1055c6ac5f8d1de5bf2da434085b9a0bd8b1809fdcb72fa58499303bcac not found: ID does not exist" Jul 18 00:51:10.043423 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.043378 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z4qn\" (UniqueName: \"kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn\") pod \"d3103a6f-546f-4f65-a35e-1078e59dbd33\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " Jul 18 00:51:10.043672 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.043450 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file\") pod \"d3103a6f-546f-4f65-a35e-1078e59dbd33\" (UID: \"d3103a6f-546f-4f65-a35e-1078e59dbd33\") " Jul 18 00:51:10.043867 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.043842 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file" (OuterVolumeSpecName: "config-file") pod "d3103a6f-546f-4f65-a35e-1078e59dbd33" (UID: "d3103a6f-546f-4f65-a35e-1078e59dbd33"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:51:10.045931 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.045892 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn" (OuterVolumeSpecName: "kube-api-access-2z4qn") pod "d3103a6f-546f-4f65-a35e-1078e59dbd33" (UID: "d3103a6f-546f-4f65-a35e-1078e59dbd33"). InnerVolumeSpecName "kube-api-access-2z4qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:10.144600 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.144558 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d3103a6f-546f-4f65-a35e-1078e59dbd33-config-file\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:10.144600 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.144592 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z4qn\" (UniqueName: \"kubernetes.io/projected/d3103a6f-546f-4f65-a35e-1078e59dbd33-kube-api-access-2z4qn\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:10.312770 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.312726 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:51:10.316343 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.316302 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nwk5t"] Jul 18 00:51:10.911250 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911196 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2"] Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911620 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88fc218b-871a-42e8-a554-5897d02b1794" containerName="authorino" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911632 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="88fc218b-871a-42e8-a554-5897d02b1794" containerName="authorino" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911642 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3103a6f-546f-4f65-a35e-1078e59dbd33" containerName="limitador" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911648 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3103a6f-546f-4f65-a35e-1078e59dbd33" containerName="limitador" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911656 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808f87e5-d793-405e-a897-cf43d9b2f3ef" containerName="console" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911661 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="808f87e5-d793-405e-a897-cf43d9b2f3ef" containerName="console" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911713 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3103a6f-546f-4f65-a35e-1078e59dbd33" containerName="limitador" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911721 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="808f87e5-d793-405e-a897-cf43d9b2f3ef" containerName="console" Jul 18 00:51:10.911861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.911729 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="88fc218b-871a-42e8-a554-5897d02b1794" containerName="authorino" Jul 18 00:51:10.915278 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.915237 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:10.922768 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.922731 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 18 00:51:10.922982 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.922731 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 18 00:51:10.924145 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.923906 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-959sk\"" Jul 18 00:51:10.924145 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.923953 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 18 00:51:10.931156 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.931113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2"] Jul 18 00:51:10.951799 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.951751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhjg\" (UniqueName: \"kubernetes.io/projected/7e583712-3277-4d00-98ed-c412fb28a7e9-kube-api-access-5hhjg\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:10.952026 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:10.951812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7e583712-3277-4d00-98ed-c412fb28a7e9-data\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.053049 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.053008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhjg\" (UniqueName: \"kubernetes.io/projected/7e583712-3277-4d00-98ed-c412fb28a7e9-kube-api-access-5hhjg\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.053244 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.053070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7e583712-3277-4d00-98ed-c412fb28a7e9-data\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.053552 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.053533 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7e583712-3277-4d00-98ed-c412fb28a7e9-data\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.062729 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.062691 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhjg\" (UniqueName: \"kubernetes.io/projected/7e583712-3277-4d00-98ed-c412fb28a7e9-kube-api-access-5hhjg\") pod \"postgres-69fb4594cf-9cdk2\" (UID: \"7e583712-3277-4d00-98ed-c412fb28a7e9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.230867 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.230762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:11.375995 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.375962 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2"] Jul 18 00:51:11.378346 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:51:11.378310 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e583712_3277_4d00_98ed_c412fb28a7e9.slice/crio-739b3f324a9e31d0204e181f283e46a75ea79efb7242ce454ba2f9c714194fc4 WatchSource:0}: Error finding container 739b3f324a9e31d0204e181f283e46a75ea79efb7242ce454ba2f9c714194fc4: Status 404 returned error can't find the container with id 739b3f324a9e31d0204e181f283e46a75ea79efb7242ce454ba2f9c714194fc4 Jul 18 00:51:11.966766 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:11.966723 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3103a6f-546f-4f65-a35e-1078e59dbd33" path="/var/lib/kubelet/pods/d3103a6f-546f-4f65-a35e-1078e59dbd33/volumes" Jul 18 00:51:12.008019 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:12.007976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" event={"ID":"7e583712-3277-4d00-98ed-c412fb28a7e9","Type":"ContainerStarted","Data":"739b3f324a9e31d0204e181f283e46a75ea79efb7242ce454ba2f9c714194fc4"} Jul 18 00:51:17.044912 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:17.044805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" event={"ID":"7e583712-3277-4d00-98ed-c412fb28a7e9","Type":"ContainerStarted","Data":"c67a1816e64403adf67df42d8d4747936d6bd581b48ce73f7c223e6a2a8b09e7"} Jul 18 00:51:17.044912 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:17.044876 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:17.060861 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:17.060803 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" podStartSLOduration=1.850694997 podStartE2EDuration="7.060785582s" totalImagesPullingTime="5.210090585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:17.059977945 +0000 UTC m=+655.594860933" watchObservedRunningTime="2026-07-18 00:51:17.060785582 +0000 UTC m=+655.595668569" Jul 18 00:51:23.081474 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.081439 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-9cdk2" Jul 18 00:51:23.630726 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.630685 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cng8x"] Jul 18 00:51:23.635862 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.635836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:23.638791 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.638763 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wqhl\"" Jul 18 00:51:23.640991 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.640953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cng8x"] Jul 18 00:51:23.772554 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.772475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzvb\" (UniqueName: \"kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb\") pod \"authorino-5d4b67c446-cng8x\" (UID: \"99f7195f-4f57-4a9e-a25e-2abc713c4fa8\") " pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:23.801207 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.801159 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cng8x"] Jul 18 00:51:23.801475 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:51:23.801454 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qhzvb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-cng8x" podUID="99f7195f-4f57-4a9e-a25e-2abc713c4fa8" Jul 18 00:51:23.833145 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.833103 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-plkpc"] Jul 18 00:51:23.836768 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.836739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:23.839459 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.839434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 18 00:51:23.843535 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.843504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-plkpc"] Jul 18 00:51:23.873720 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.873678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzvb\" (UniqueName: \"kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb\") pod \"authorino-5d4b67c446-cng8x\" (UID: \"99f7195f-4f57-4a9e-a25e-2abc713c4fa8\") " pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:23.882817 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.882672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzvb\" (UniqueName: \"kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb\") pod \"authorino-5d4b67c446-cng8x\" (UID: \"99f7195f-4f57-4a9e-a25e-2abc713c4fa8\") " pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:23.885835 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.885801 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-plkpc"] Jul 18 00:51:23.886109 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:51:23.886087 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x2s4m tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-x2s4m tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-plkpc" podUID="f7126d34-bc17-498c-bf6e-5527c207c2ef" Jul 18 00:51:23.916359 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.916321 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:51:23.919902 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.919879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:23.931699 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.931663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:51:23.974391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.974346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2s4m\" (UniqueName: \"kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:23.974391 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.974403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:23.974665 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.974434 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:23.974665 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:23.974542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-przss\" (UniqueName: \"kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.076024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.075979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-przss\" (UniqueName: \"kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.076228 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.076143 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2s4m\" (UniqueName: \"kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.076519 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.076456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.076622 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.076590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.079372 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.079339 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.079533 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.079413 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.086425 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.085824 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2s4m\" (UniqueName: \"kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m\") pod \"authorino-76877994-plkpc\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.090580 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.089731 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-przss\" (UniqueName: \"kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss\") pod \"authorino-599fbc84c8-kd2s5\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.095603 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.095571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.095783 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.095572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:24.107871 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.107840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:24.111257 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.111228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:24.177953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.177857 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2s4m\" (UniqueName: \"kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m\") pod \"f7126d34-bc17-498c-bf6e-5527c207c2ef\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " Jul 18 00:51:24.177953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.177926 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhzvb\" (UniqueName: \"kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb\") pod \"99f7195f-4f57-4a9e-a25e-2abc713c4fa8\" (UID: \"99f7195f-4f57-4a9e-a25e-2abc713c4fa8\") " Jul 18 00:51:24.177953 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.177953 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert\") pod \"f7126d34-bc17-498c-bf6e-5527c207c2ef\" (UID: \"f7126d34-bc17-498c-bf6e-5527c207c2ef\") " Jul 18 00:51:24.180356 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.180306 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m" (OuterVolumeSpecName: "kube-api-access-x2s4m") pod "f7126d34-bc17-498c-bf6e-5527c207c2ef" (UID: "f7126d34-bc17-498c-bf6e-5527c207c2ef"). InnerVolumeSpecName "kube-api-access-x2s4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:24.180356 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.180326 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb" (OuterVolumeSpecName: "kube-api-access-qhzvb") pod "99f7195f-4f57-4a9e-a25e-2abc713c4fa8" (UID: "99f7195f-4f57-4a9e-a25e-2abc713c4fa8"). InnerVolumeSpecName "kube-api-access-qhzvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:24.180356 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.180335 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f7126d34-bc17-498c-bf6e-5527c207c2ef" (UID: "f7126d34-bc17-498c-bf6e-5527c207c2ef"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:51:24.230764 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.230721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:51:24.278669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.278629 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2s4m\" (UniqueName: \"kubernetes.io/projected/f7126d34-bc17-498c-bf6e-5527c207c2ef-kube-api-access-x2s4m\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:24.278669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.278663 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhzvb\" (UniqueName: \"kubernetes.io/projected/99f7195f-4f57-4a9e-a25e-2abc713c4fa8-kube-api-access-qhzvb\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:24.278669 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.278676 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7126d34-bc17-498c-bf6e-5527c207c2ef-tls-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:51:24.377909 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:24.377880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:51:24.380157 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:51:24.380132 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e41de46_34dc_4b44_8e77_c4cc8847154d.slice/crio-7705ebba227cbb209a43bf38e6d24cf15be6b27b0ffbaab2de1cb28cb5de1ba3 WatchSource:0}: Error finding container 7705ebba227cbb209a43bf38e6d24cf15be6b27b0ffbaab2de1cb28cb5de1ba3: Status 404 returned error can't find the container with id 7705ebba227cbb209a43bf38e6d24cf15be6b27b0ffbaab2de1cb28cb5de1ba3 Jul 18 00:51:25.103379 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.103342 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" event={"ID":"5e41de46-34dc-4b44-8e77-c4cc8847154d","Type":"ContainerStarted","Data":"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3"} Jul 18 00:51:25.103379 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.103390 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" event={"ID":"5e41de46-34dc-4b44-8e77-c4cc8847154d","Type":"ContainerStarted","Data":"7705ebba227cbb209a43bf38e6d24cf15be6b27b0ffbaab2de1cb28cb5de1ba3"} Jul 18 00:51:25.104063 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.103413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cng8x" Jul 18 00:51:25.104063 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.103431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-plkpc" Jul 18 00:51:25.123386 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.123331 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" podStartSLOduration=1.793336396 podStartE2EDuration="2.123311018s" totalImagesPullingTime="329.974622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:25.122017906 +0000 UTC m=+663.656900901" watchObservedRunningTime="2026-07-18 00:51:25.123311018 +0000 UTC m=+663.658194004" Jul 18 00:51:25.147641 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.147601 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-plkpc"] Jul 18 00:51:25.159077 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.159037 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-plkpc"] Jul 18 00:51:25.181326 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.181278 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cng8x"] Jul 18 00:51:25.184817 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.184783 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cng8x"] Jul 18 00:51:25.966084 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.966032 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99f7195f-4f57-4a9e-a25e-2abc713c4fa8" path="/var/lib/kubelet/pods/99f7195f-4f57-4a9e-a25e-2abc713c4fa8/volumes" Jul 18 00:51:25.966405 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:51:25.966386 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7126d34-bc17-498c-bf6e-5527c207c2ef" path="/var/lib/kubelet/pods/f7126d34-bc17-498c-bf6e-5527c207c2ef/volumes" Jul 18 00:52:27.417771 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.417678 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms"] Jul 18 00:52:27.421633 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.421603 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.425805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.425758 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 00:52:27.425805 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.425802 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 18 00:52:27.426052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.425764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q8kn7\"" Jul 18 00:52:27.426052 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.425857 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 00:52:27.432884 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.432844 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms"] Jul 18 00:52:27.467818 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.467775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.468022 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.467835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.468022 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.467902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbmzt\" (UniqueName: \"kubernetes.io/projected/71930899-3e9a-47a2-8609-2c491b44dd7e-kube-api-access-jbmzt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.468022 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.467952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.468022 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.467992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71930899-3e9a-47a2-8609-2c491b44dd7e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.468170 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.468036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.568804 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbmzt\" (UniqueName: \"kubernetes.io/projected/71930899-3e9a-47a2-8609-2c491b44dd7e-kube-api-access-jbmzt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71930899-3e9a-47a2-8609-2c491b44dd7e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569001 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.568984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569351 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.569317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569534 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.569428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.569534 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.569451 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.571620 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.571598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71930899-3e9a-47a2-8609-2c491b44dd7e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.571745 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.571727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71930899-3e9a-47a2-8609-2c491b44dd7e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.577442 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.577415 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbmzt\" (UniqueName: \"kubernetes.io/projected/71930899-3e9a-47a2-8609-2c491b44dd7e-kube-api-access-jbmzt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms\" (UID: \"71930899-3e9a-47a2-8609-2c491b44dd7e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.735495 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.735446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:27.883848 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.883816 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms"] Jul 18 00:52:27.886647 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:52:27.886619 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71930899_3e9a_47a2_8609_2c491b44dd7e.slice/crio-090da06190ad8189c5fb024e5c1624e4906fc34cdc159d21780d3d9b909e5177 WatchSource:0}: Error finding container 090da06190ad8189c5fb024e5c1624e4906fc34cdc159d21780d3d9b909e5177: Status 404 returned error can't find the container with id 090da06190ad8189c5fb024e5c1624e4906fc34cdc159d21780d3d9b909e5177 Jul 18 00:52:27.891440 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:27.891416 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:52:28.470472 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:28.470431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" event={"ID":"71930899-3e9a-47a2-8609-2c491b44dd7e","Type":"ContainerStarted","Data":"090da06190ad8189c5fb024e5c1624e4906fc34cdc159d21780d3d9b909e5177"} Jul 18 00:52:29.478251 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:29.478207 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" event={"ID":"71930899-3e9a-47a2-8609-2c491b44dd7e","Type":"ContainerStarted","Data":"43e9d8e6235103a2b135305c4327a1318331569e5ed5ea19ace05e6aa5aa50db"} Jul 18 00:52:29.498066 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:29.498001 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" podStartSLOduration=1.386398721 podStartE2EDuration="2.497979896s" totalImagesPullingTime="1.111581175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:52:29.495934054 +0000 UTC m=+728.030817042" watchObservedRunningTime="2026-07-18 00:52:29.497979896 +0000 UTC m=+728.032862926" Jul 18 00:52:37.736078 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:37.736017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:37.736078 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:37.736103 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:37.749044 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:37.749012 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:52:38.540110 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:52:38.540069 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms" Jul 18 00:53:04.123089 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.123050 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss"] Jul 18 00:53:04.130174 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.130140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.133103 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.133073 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 18 00:53:04.135045 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.135015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss"] Jul 18 00:53:04.205652 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205615 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.205652 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18703124-4575-4418-9a9d-2fd07756dbb1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.205950 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.205950 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.205950 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv6gw\" (UniqueName: \"kubernetes.io/projected/18703124-4575-4418-9a9d-2fd07756dbb1-kube-api-access-hv6gw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.205950 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.205836 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306410 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18703124-4575-4418-9a9d-2fd07756dbb1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306728 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306728 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306728 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv6gw\" (UniqueName: \"kubernetes.io/projected/18703124-4575-4418-9a9d-2fd07756dbb1-kube-api-access-hv6gw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306728 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.306951 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.307010 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.306981 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.307069 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.307037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.309063 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.309038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18703124-4575-4418-9a9d-2fd07756dbb1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.309204 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.309185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18703124-4575-4418-9a9d-2fd07756dbb1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.315141 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.315104 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv6gw\" (UniqueName: \"kubernetes.io/projected/18703124-4575-4418-9a9d-2fd07756dbb1-kube-api-access-hv6gw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss\" (UID: \"18703124-4575-4418-9a9d-2fd07756dbb1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.443267 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.443164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:04.590105 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.590080 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss"] Jul 18 00:53:04.591672 ip-10-0-136-82 kubenswrapper[2577]: W0718 00:53:04.591642 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18703124_4575_4418_9a9d_2fd07756dbb1.slice/crio-90369bbd6cef4050e7e273be0d57112d05d6fa1c033cf1402074bf813767068c WatchSource:0}: Error finding container 90369bbd6cef4050e7e273be0d57112d05d6fa1c033cf1402074bf813767068c: Status 404 returned error can't find the container with id 90369bbd6cef4050e7e273be0d57112d05d6fa1c033cf1402074bf813767068c Jul 18 00:53:04.674741 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:04.674707 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" event={"ID":"18703124-4575-4418-9a9d-2fd07756dbb1","Type":"ContainerStarted","Data":"90369bbd6cef4050e7e273be0d57112d05d6fa1c033cf1402074bf813767068c"} Jul 18 00:53:05.682053 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:05.682014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" event={"ID":"18703124-4575-4418-9a9d-2fd07756dbb1","Type":"ContainerStarted","Data":"2f57d627a01fca13e04aade0eddb6952fd20094686c91bb98498fea923527fe8"} Jul 18 00:53:05.701050 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:05.700984 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" podStartSLOduration=1.530221639 podStartE2EDuration="1.70096014s" totalImagesPullingTime="170.738501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:53:05.699071468 +0000 UTC m=+764.233954455" watchObservedRunningTime="2026-07-18 00:53:05.70096014 +0000 UTC m=+764.235843128" Jul 18 00:53:14.444146 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:14.444097 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:14.444683 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:14.444160 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:14.456703 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:14.456672 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:53:14.744532 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:53:14.744423 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss" Jul 18 00:54:43.326397 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.326348 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:54:43.326996 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.326602 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" podUID="5e41de46-34dc-4b44-8e77-c4cc8847154d" containerName="authorino" containerID="cri-o://663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3" gracePeriod=30 Jul 18 00:54:43.586287 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.586209 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:54:43.728750 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.728715 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-przss\" (UniqueName: \"kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss\") pod \"5e41de46-34dc-4b44-8e77-c4cc8847154d\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " Jul 18 00:54:43.728750 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.728768 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert\") pod \"5e41de46-34dc-4b44-8e77-c4cc8847154d\" (UID: \"5e41de46-34dc-4b44-8e77-c4cc8847154d\") " Jul 18 00:54:43.731125 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.731086 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss" (OuterVolumeSpecName: "kube-api-access-przss") pod "5e41de46-34dc-4b44-8e77-c4cc8847154d" (UID: "5e41de46-34dc-4b44-8e77-c4cc8847154d"). InnerVolumeSpecName "kube-api-access-przss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:54:43.740689 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.740648 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5e41de46-34dc-4b44-8e77-c4cc8847154d" (UID: "5e41de46-34dc-4b44-8e77-c4cc8847154d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:54:43.830085 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.830043 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-przss\" (UniqueName: \"kubernetes.io/projected/5e41de46-34dc-4b44-8e77-c4cc8847154d-kube-api-access-przss\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:54:43.830085 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:43.830078 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5e41de46-34dc-4b44-8e77-c4cc8847154d-tls-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 00:54:44.228987 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.228897 2577 generic.go:356] "Generic (PLEG): container finished" podID="5e41de46-34dc-4b44-8e77-c4cc8847154d" containerID="663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3" exitCode=0 Jul 18 00:54:44.228987 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.228947 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" Jul 18 00:54:44.229174 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.228986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" event={"ID":"5e41de46-34dc-4b44-8e77-c4cc8847154d","Type":"ContainerDied","Data":"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3"} Jul 18 00:54:44.229174 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.229031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-599fbc84c8-kd2s5" event={"ID":"5e41de46-34dc-4b44-8e77-c4cc8847154d","Type":"ContainerDied","Data":"7705ebba227cbb209a43bf38e6d24cf15be6b27b0ffbaab2de1cb28cb5de1ba3"} Jul 18 00:54:44.229174 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.229054 2577 scope.go:117] "RemoveContainer" containerID="663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3" Jul 18 00:54:44.239024 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.239001 2577 scope.go:117] "RemoveContainer" containerID="663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3" Jul 18 00:54:44.239368 ip-10-0-136-82 kubenswrapper[2577]: E0718 00:54:44.239347 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3\": container with ID starting with 663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3 not found: ID does not exist" containerID="663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3" Jul 18 00:54:44.239444 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.239379 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3"} err="failed to get container status \"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3\": rpc error: code = NotFound desc = could not find container \"663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3\": container with ID starting with 663960b1ccbd7181df103f9f6f59664d69d88c2dde9f0eee89f6bfa9b29641a3 not found: ID does not exist" Jul 18 00:54:44.254184 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.254125 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:54:44.254371 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:44.254208 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-599fbc84c8-kd2s5"] Jul 18 00:54:45.965814 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:54:45.965781 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e41de46-34dc-4b44-8e77-c4cc8847154d" path="/var/lib/kubelet/pods/5e41de46-34dc-4b44-8e77-c4cc8847154d/volumes" Jul 18 00:55:37.198752 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:55:37.198719 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 00:55:37.201202 ip-10-0-136-82 kubenswrapper[2577]: I0718 00:55:37.199815 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:00:37.235009 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:00:37.234899 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:00:37.239120 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:00:37.237547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:05:37.272517 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:05:37.272366 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:05:37.276612 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:05:37.276587 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:10:34.423711 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.423676 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:10:34.424196 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.424055 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e41de46-34dc-4b44-8e77-c4cc8847154d" containerName="authorino" Jul 18 01:10:34.424196 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.424068 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e41de46-34dc-4b44-8e77-c4cc8847154d" containerName="authorino" Jul 18 01:10:34.424196 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.424153 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e41de46-34dc-4b44-8e77-c4cc8847154d" containerName="authorino" Jul 18 01:10:34.427159 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.427140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.430109 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.430085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5d7b09a4-openshift-default-dockercfg-7qsw6\"" Jul 18 01:10:34.430109 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.430103 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:10:34.450954 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.450922 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:10:34.493787 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.493958 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.493958 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.493958 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b56d\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.493958 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.494101 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.493998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.494101 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.494024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.494101 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.494051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.494195 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.494130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594637 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594598 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594637 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b56d\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594677 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594836 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.594900 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.594872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.595300 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.595102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.595432 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.595405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.595551 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.595535 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.595670 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.595647 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.595731 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.595683 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.597648 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.597624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.597808 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.597789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.603603 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.603576 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.603741 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.603720 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b56d\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d\") pod \"e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.738325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.738235 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:34.889020 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.888992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:10:34.890662 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:10:34.890633 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593b47b8_b718_4095_a5ec_f785fccfc3ae.slice/crio-9e925266cd643c129befa8d8473d22a07a68e9ae29300712f40057740a716ad6 WatchSource:0}: Error finding container 9e925266cd643c129befa8d8473d22a07a68e9ae29300712f40057740a716ad6: Status 404 returned error can't find the container with id 9e925266cd643c129befa8d8473d22a07a68e9ae29300712f40057740a716ad6 Jul 18 01:10:34.892768 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:34.892751 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:10:35.399834 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:35.399800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerStarted","Data":"9e925266cd643c129befa8d8473d22a07a68e9ae29300712f40057740a716ad6"} Jul 18 01:10:37.674180 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:37.674155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:10:37.676458 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:37.674845 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:10:37.717719 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:37.717681 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:37.717817 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:37.717760 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:37.717817 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:37.717792 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:38.420802 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:38.420768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerStarted","Data":"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160"} Jul 18 01:10:38.442265 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:38.442211 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podStartSLOduration=1.6177280490000001 podStartE2EDuration="4.442194797s" totalImagesPullingTime="2.824466748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:10:38.43942365 +0000 UTC m=+1816.974306637" watchObservedRunningTime="2026-07-18 01:10:38.442194797 +0000 UTC m=+1816.977077783" Jul 18 01:10:38.739112 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:38.739005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:38.744242 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:38.744213 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:39.432535 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:39.432505 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:39.433702 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:39.433677 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:52.511304 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.511270 2577 generic.go:356] "Generic (PLEG): container finished" podID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerID="6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160" exitCode=0 Jul 18 01:10:52.511765 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.511352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerDied","Data":"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160"} Jul 18 01:10:52.511811 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.511773 2577 scope.go:117] "RemoveContainer" containerID="6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160" Jul 18 01:10:52.513847 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.513815 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:52.513935 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.513890 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:52.513935 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:52.513924 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:10:53.518588 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:53.518546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerStarted","Data":"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b"} Jul 18 01:10:53.739054 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:53.739010 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:53.740347 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:53.740321 2577 patch_prober.go:28] interesting pod/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 18 01:10:53.740458 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:53.740377 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 18 01:10:54.432760 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:54.432720 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:54.739401 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:54.739310 2577 patch_prober.go:28] interesting pod/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 18 01:10:54.739401 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:54.739370 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 18 01:10:55.738790 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:55.738748 2577 patch_prober.go:28] interesting pod/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 18 01:10:55.738985 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:55.738806 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 18 01:10:56.739439 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:56.739394 2577 patch_prober.go:28] interesting pod/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 18 01:10:56.739961 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:56.739468 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 18 01:10:57.743250 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:57.743222 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:57.744613 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:57.744589 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:10:58.670369 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:58.670027 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:10:59.550126 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:10:59.550087 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" containerID="cri-o://857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b" gracePeriod=30 Jul 18 01:11:04.807054 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.807020 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:11:04.982043 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.981946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982043 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.981984 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982043 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982040 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b56d\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982062 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982090 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982117 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982140 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982181 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982217 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo\") pod \"593b47b8-b718-4095-a5ec-f785fccfc3ae\" (UID: \"593b47b8-b718-4095-a5ec-f785fccfc3ae\") " Jul 18 01:11:04.982325 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982239 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:11:04.982738 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982466 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:11:04.982738 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982519 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:04.982738 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982726 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:11:04.982880 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.982663 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:11:04.983200 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.983165 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:11:04.984704 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.984673 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:11:04.984704 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.984692 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:11:04.984839 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.984730 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d" (OuterVolumeSpecName: "kube-api-access-9b56d") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "kube-api-access-9b56d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:11:04.984839 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:04.984771 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "593b47b8-b718-4095-a5ec-f785fccfc3ae" (UID: "593b47b8-b718-4095-a5ec-f785fccfc3ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:11:05.084397 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084325 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b56d\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-kube-api-access-9b56d\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084365 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084448 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-data\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084463 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-credential-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084475 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/593b47b8-b718-4095-a5ec-f785fccfc3ae-istiod-ca-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084505 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-workload-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084516 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-podinfo\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.084635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.084529 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/593b47b8-b718-4095-a5ec-f785fccfc3ae-istio-envoy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:11:05.584960 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.584927 2577 generic.go:356] "Generic (PLEG): container finished" podID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerID="857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b" exitCode=0 Jul 18 01:11:05.585146 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.584989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerDied","Data":"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b"} Jul 18 01:11:05.585146 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.585002 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" Jul 18 01:11:05.585146 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.585034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk" event={"ID":"593b47b8-b718-4095-a5ec-f785fccfc3ae","Type":"ContainerDied","Data":"9e925266cd643c129befa8d8473d22a07a68e9ae29300712f40057740a716ad6"} Jul 18 01:11:05.585146 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.585058 2577 scope.go:117] "RemoveContainer" containerID="857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b" Jul 18 01:11:05.595092 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.595069 2577 scope.go:117] "RemoveContainer" containerID="6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160" Jul 18 01:11:05.603995 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.603974 2577 scope.go:117] "RemoveContainer" containerID="857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b" Jul 18 01:11:05.604310 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:11:05.604290 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b\": container with ID starting with 857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b not found: ID does not exist" containerID="857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b" Jul 18 01:11:05.604365 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.604321 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b"} err="failed to get container status \"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b\": rpc error: code = NotFound desc = could not find container \"857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b\": container with ID starting with 857e52bebc0bec879556a42227ea8120f541b2deeb670f59907ca87edb2dcc0b not found: ID does not exist" Jul 18 01:11:05.604365 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.604341 2577 scope.go:117] "RemoveContainer" containerID="6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160" Jul 18 01:11:05.604642 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:11:05.604623 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160\": container with ID starting with 6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160 not found: ID does not exist" containerID="6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160" Jul 18 01:11:05.604715 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.604652 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160"} err="failed to get container status \"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160\": rpc error: code = NotFound desc = could not find container \"6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160\": container with ID starting with 6c1be1e8ff38e022c2d1221914665394ab94afdf59a981d1663cfad02fbc7160 not found: ID does not exist" Jul 18 01:11:05.607960 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.607934 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:11:05.614260 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.614236 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5d7b09a4-openshift-default-69797b4fdc-9t2lk"] Jul 18 01:11:05.966107 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:05.966027 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" path="/var/lib/kubelet/pods/593b47b8-b718-4095-a5ec-f785fccfc3ae/volumes" Jul 18 01:11:18.079133 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079094 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:11:18.079641 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079543 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.079641 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079560 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.079641 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079580 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.079641 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079585 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.079836 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079661 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.079836 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.079667 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="593b47b8-b718-4095-a5ec-f785fccfc3ae" containerName="istio-proxy" Jul 18 01:11:18.082308 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.082287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.085075 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.085049 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:11:18.085231 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.085102 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3482f028-openshift-default-dockercfg-5z272\"" Jul 18 01:11:18.095861 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.095827 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:11:18.119696 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.119893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.119893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.119893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.119893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119865 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.119893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119889 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xrz\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.120090 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.120090 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.119986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.120090 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.120025 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.220888 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.220834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.220914 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.220943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.220988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xrz\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221102 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221477 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221477 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221337 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221673 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221651 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221744 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.221901 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.221882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.222087 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.222065 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.223778 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.223756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.223958 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.223942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.230578 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.230545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.231041 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.231023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xrz\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz\") pod \"e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.395116 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.395022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:18.545817 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.545790 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:11:18.547877 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:11:18.547846 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f00386e_9f60_4f02_acba_0dc4f7c5ac81.slice/crio-3a8afb6a39aedd66d68b332f90579ab4576be648a0d83b261f46c29067ec7049 WatchSource:0}: Error finding container 3a8afb6a39aedd66d68b332f90579ab4576be648a0d83b261f46c29067ec7049: Status 404 returned error can't find the container with id 3a8afb6a39aedd66d68b332f90579ab4576be648a0d83b261f46c29067ec7049 Jul 18 01:11:18.550251 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.550216 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:18.550323 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.550291 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:18.550365 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.550320 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:18.660947 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.660842 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerStarted","Data":"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931"} Jul 18 01:11:18.660947 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.660909 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerStarted","Data":"3a8afb6a39aedd66d68b332f90579ab4576be648a0d83b261f46c29067ec7049"} Jul 18 01:11:18.686332 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:18.686275 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podStartSLOduration=0.686258404 podStartE2EDuration="686.258404ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:11:18.684639775 +0000 UTC m=+1857.219522763" watchObservedRunningTime="2026-07-18 01:11:18.686258404 +0000 UTC m=+1857.221141391" Jul 18 01:11:19.395365 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:19.395319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:19.400781 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:19.400755 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:19.667151 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:19.667065 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:19.668047 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:19.668029 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:35.160569 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.160529 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": read tcp 10.132.0.2:58492->10.132.0.50:15021: read: connection reset by peer" start-of-body= Jul 18 01:11:35.161005 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.160627 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": read tcp 10.132.0.2:58492->10.132.0.50:15021: read: connection reset by peer" Jul 18 01:11:35.762456 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.762422 2577 generic.go:356] "Generic (PLEG): container finished" podID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerID="1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931" exitCode=0 Jul 18 01:11:35.762662 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.762524 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerDied","Data":"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931"} Jul 18 01:11:35.762990 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.762976 2577 scope.go:117] "RemoveContainer" containerID="1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931" Jul 18 01:11:35.764042 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.764016 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:35.764103 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.764094 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:35.764140 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:35.764127 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:11:36.770030 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:36.769996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerStarted","Data":"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125"} Jul 18 01:11:37.395694 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:37.395647 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:37.395934 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:37.395793 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 18 01:11:37.395934 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:37.395860 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 18 01:11:38.396589 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:38.396539 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 18 01:11:38.397112 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:38.396613 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 18 01:11:39.396165 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:39.396117 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 18 01:11:39.396397 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:39.396210 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 18 01:11:40.395552 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:40.395510 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 18 01:11:40.396087 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:40.395582 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 18 01:11:41.399701 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:41.399673 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:41.400194 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:41.399919 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:11:41.400703 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:11:41.400684 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:13:07.014018 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:07.013979 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:13:07.014604 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:07.014184 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" containerID="cri-o://8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125" gracePeriod=30 Jul 18 01:13:11.403045 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:11.403003 2577 patch_prober.go:28] interesting pod/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 01:13:11.403443 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:11.403066 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 01:13:12.266716 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.266690 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:13:12.303460 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.303355 2577 generic.go:356] "Generic (PLEG): container finished" podID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerID="8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125" exitCode=0 Jul 18 01:13:12.303679 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.303503 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" Jul 18 01:13:12.303679 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.303519 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerDied","Data":"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125"} Jul 18 01:13:12.303679 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.303582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp" event={"ID":"0f00386e-9f60-4f02-acba-0dc4f7c5ac81","Type":"ContainerDied","Data":"3a8afb6a39aedd66d68b332f90579ab4576be648a0d83b261f46c29067ec7049"} Jul 18 01:13:12.303679 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.303607 2577 scope.go:117] "RemoveContainer" containerID="8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125" Jul 18 01:13:12.317968 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.317946 2577 scope.go:117] "RemoveContainer" containerID="1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931" Jul 18 01:13:12.327683 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.327664 2577 scope.go:117] "RemoveContainer" containerID="8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125" Jul 18 01:13:12.328013 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:13:12.327991 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125\": container with ID starting with 8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125 not found: ID does not exist" containerID="8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125" Jul 18 01:13:12.328112 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.328023 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125"} err="failed to get container status \"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125\": rpc error: code = NotFound desc = could not find container \"8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125\": container with ID starting with 8bb85a972440e6722a9df785a55a3f5a7ab99506148b5936c1e5b3e33f375125 not found: ID does not exist" Jul 18 01:13:12.328112 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.328044 2577 scope.go:117] "RemoveContainer" containerID="1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931" Jul 18 01:13:12.328327 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:13:12.328310 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931\": container with ID starting with 1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931 not found: ID does not exist" containerID="1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931" Jul 18 01:13:12.328387 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.328331 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931"} err="failed to get container status \"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931\": rpc error: code = NotFound desc = could not find container \"1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931\": container with ID starting with 1b43cd7c109a1360194d7eb99290165ce6fbd864bd96d313bdc9b1f39eca3931 not found: ID does not exist" Jul 18 01:13:12.397019 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.396977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397039 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397082 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397102 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8xrz\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397176 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397474 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397359 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397474 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397380 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:12.397474 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397386 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397675 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397544 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket\") pod \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\" (UID: \"0f00386e-9f60-4f02-acba-0dc4f7c5ac81\") " Jul 18 01:13:12.397675 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397610 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:12.397675 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397628 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:13:12.397917 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397893 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-credential-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.398155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397924 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istiod-ca-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.398155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397928 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:12.398155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.397938 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.398155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.398055 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:12.399690 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.399670 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:13:12.399811 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.399707 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:13:12.400213 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.400187 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz" (OuterVolumeSpecName: "kube-api-access-r8xrz") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "kube-api-access-r8xrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:13:12.400213 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.400182 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f00386e-9f60-4f02-acba-0dc4f7c5ac81" (UID: "0f00386e-9f60-4f02-acba-0dc4f7c5ac81"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:13:12.499003 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.498961 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8xrz\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-kube-api-access-r8xrz\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.499003 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.498998 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-podinfo\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.499003 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.499008 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-envoy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.499003 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.499016 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-workload-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.499537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.499024 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-data\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.499537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.499031 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f00386e-9f60-4f02-acba-0dc4f7c5ac81-istio-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:13:12.626577 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.626535 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:13:12.628866 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:12.628835 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3482f028-openshift-default-86dfc9bc95-h6jkp"] Jul 18 01:13:13.965866 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:13:13.965829 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" path="/var/lib/kubelet/pods/0f00386e-9f60-4f02-acba-0dc4f7c5ac81/volumes" Jul 18 01:14:09.531058 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531018 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:14:09.531707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531544 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:09.531707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531560 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:09.531707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531598 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:09.531707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531607 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:09.531707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.531689 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:09.533712 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.533692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.536728 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.536700 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:14:09.536987 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.536972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b13551-openshift-default-dockercfg-tzmqz\"" Jul 18 01:14:09.547627 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.547591 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:14:09.616165 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616165 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616221 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616300 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616390 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4228t\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.616464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.616435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717521 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717721 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717721 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717840 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4228t\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717840 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717840 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717992 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717992 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717992 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.717992 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.717962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.718221 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.718200 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.718347 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.718320 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.718412 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.718372 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.718412 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.718393 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.720373 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.720349 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.720631 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.720613 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.725975 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.725942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.726132 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.726068 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4228t\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t\") pod \"e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.846033 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.845994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:09.996098 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:09.995892 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:14:09.999309 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:14:09.999275 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f24a75_444f_480f_8989_1a97febbd7e9.slice/crio-2a036cac1f1c6a4d09cc6be7f241825b79e4e9abedce9e7899be2daab796ff19 WatchSource:0}: Error finding container 2a036cac1f1c6a4d09cc6be7f241825b79e4e9abedce9e7899be2daab796ff19: Status 404 returned error can't find the container with id 2a036cac1f1c6a4d09cc6be7f241825b79e4e9abedce9e7899be2daab796ff19 Jul 18 01:14:10.001567 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.001532 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:10.001651 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.001602 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:10.001651 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.001633 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:10.631334 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.631297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerStarted","Data":"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c"} Jul 18 01:14:10.631831 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.631352 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerStarted","Data":"2a036cac1f1c6a4d09cc6be7f241825b79e4e9abedce9e7899be2daab796ff19"} Jul 18 01:14:10.653041 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.652992 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podStartSLOduration=1.652975086 podStartE2EDuration="1.652975086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:10.650354443 +0000 UTC m=+2029.185237432" watchObservedRunningTime="2026-07-18 01:14:10.652975086 +0000 UTC m=+2029.187858074" Jul 18 01:14:10.846549 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:10.846477 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:11.852165 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:11.852135 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:12.642250 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:12.642214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:12.643172 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:12.643154 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:28.160005 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.159406 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:58668->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 18 01:14:28.160005 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.159518 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:58668->10.132.0.51:15021: read: connection reset by peer" Jul 18 01:14:28.741260 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.741212 2577 generic.go:356] "Generic (PLEG): container finished" podID="93f24a75-444f-480f-8989-1a97febbd7e9" containerID="34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c" exitCode=0 Jul 18 01:14:28.741504 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.741292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerDied","Data":"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c"} Jul 18 01:14:28.741767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.741750 2577 scope.go:117] "RemoveContainer" containerID="34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c" Jul 18 01:14:28.742829 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.742796 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:28.742909 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.742870 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:28.742909 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:28.742903 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:14:29.750629 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:29.750592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerStarted","Data":"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7"} Jul 18 01:14:29.846168 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:29.846131 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:29.846426 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:29.846398 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 18 01:14:29.846541 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:29.846458 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 18 01:14:30.847504 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:30.847442 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 18 01:14:30.847946 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:30.847529 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 18 01:14:31.846509 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:31.846435 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 18 01:14:31.846700 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:31.846534 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 18 01:14:32.846823 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:32.846772 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 18 01:14:32.847238 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:32.846848 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 18 01:14:33.846661 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:33.846615 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 18 01:14:33.846861 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:33.846714 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 18 01:14:34.850852 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:34.850818 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:34.851239 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:34.851073 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:34.852046 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:34.852028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:14:37.397378 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.397346 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:14:37.398043 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.398023 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f00386e-9f60-4f02-acba-0dc4f7c5ac81" containerName="istio-proxy" Jul 18 01:14:37.401999 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.401980 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.406047 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.406024 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9d3231\"/\"kube-root-ca.crt\"" Jul 18 01:14:37.406184 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.406090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9d3231\"/\"openshift-service-ca.crt\"" Jul 18 01:14:37.406184 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.406090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9d3231\"/\"test-model-9d3231-kserve-self-signed-certs\"" Jul 18 01:14:37.406184 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.406024 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9d3231\"/\"default-dockercfg-kdqlq\"" Jul 18 01:14:37.411940 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.411914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:14:37.483444 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.483640 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.483640 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.483640 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.483640 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2nf\" (UniqueName: \"kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.483851 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.483645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.584810 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585031 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585031 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584917 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585031 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585031 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2nf\" (UniqueName: \"kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585031 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.584990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585311 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.585275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585311 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.585299 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.585404 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.585340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.587525 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.587470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.587646 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.587620 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.592880 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.592859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2nf\" (UniqueName: \"kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf\") pod \"test-model-9d3231-kserve-6684bc6569-ktqck\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.713163 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.713067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:37.856332 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:37.856303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:14:37.857152 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:14:37.857129 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7867334_ec7e_49e1_a0e0_8ada678d2383.slice/crio-aee1aa19698c4502263cc2c55454bef3cbe1709664cf31a0e57ba0cfa495948a WatchSource:0}: Error finding container aee1aa19698c4502263cc2c55454bef3cbe1709664cf31a0e57ba0cfa495948a: Status 404 returned error can't find the container with id aee1aa19698c4502263cc2c55454bef3cbe1709664cf31a0e57ba0cfa495948a Jul 18 01:14:38.807884 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:38.807843 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" event={"ID":"e7867334-ec7e-49e1-a0e0-8ada678d2383","Type":"ContainerStarted","Data":"dc63c051f551408d481a34ffea894a93fbf9d0cabf57e4053ed63ee668976061"} Jul 18 01:14:38.808310 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:38.807902 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" event={"ID":"e7867334-ec7e-49e1-a0e0-8ada678d2383","Type":"ContainerStarted","Data":"aee1aa19698c4502263cc2c55454bef3cbe1709664cf31a0e57ba0cfa495948a"} Jul 18 01:14:38.826140 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:38.826075 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" podStartSLOduration=1.8260490919999999 podStartE2EDuration="1.826049092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:38.823773439 +0000 UTC m=+2057.358656427" watchObservedRunningTime="2026-07-18 01:14:38.826049092 +0000 UTC m=+2057.360932087" Jul 18 01:14:47.714021 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:47.713977 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:47.714465 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:47.714038 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:47.726921 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:47.726890 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:14:47.870476 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:14:47.870443 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:15:07.733751 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.733717 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:07.737135 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.737114 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.741661 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.741620 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b13551\"/\"kube-root-ca.crt\"" Jul 18 01:15:07.741661 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.741644 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b13551\"/\"test-model-b13551-kserve-self-signed-certs\"" Jul 18 01:15:07.741901 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.741673 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b13551\"/\"default-dockercfg-knmdm\"" Jul 18 01:15:07.741901 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.741673 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b13551\"/\"openshift-service-ca.crt\"" Jul 18 01:15:07.749844 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.749814 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:07.765502 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.765692 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765536 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.765692 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.765692 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.765692 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp4rf\" (UniqueName: \"kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.765692 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.765679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.866670 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.866890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp4rf\" (UniqueName: \"kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.866890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.866890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.866890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.867205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.866994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.867205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.867112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.867205 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.867165 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.867337 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.867220 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.869419 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.869385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.869583 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.869472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:07.875429 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:07.875401 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp4rf\" (UniqueName: \"kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf\") pod \"test-model-b13551-kserve-54d6fdc575-pxmqb\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:08.048065 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:08.047974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:08.194533 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:08.194503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:08.196635 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:15:08.196592 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fb44f13_c39f_4108_9465_aecce26ede66.slice/crio-d0b2d16621f232a292fb1e3c414fa5a33def170b88b0c9f302d11239c997ea7e WatchSource:0}: Error finding container d0b2d16621f232a292fb1e3c414fa5a33def170b88b0c9f302d11239c997ea7e: Status 404 returned error can't find the container with id d0b2d16621f232a292fb1e3c414fa5a33def170b88b0c9f302d11239c997ea7e Jul 18 01:15:08.973889 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:08.973851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" event={"ID":"1fb44f13-c39f-4108-9465-aecce26ede66","Type":"ContainerStarted","Data":"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04"} Jul 18 01:15:08.973889 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:08.973891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" event={"ID":"1fb44f13-c39f-4108-9465-aecce26ede66","Type":"ContainerStarted","Data":"d0b2d16621f232a292fb1e3c414fa5a33def170b88b0c9f302d11239c997ea7e"} Jul 18 01:15:08.992176 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:08.992114 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" podStartSLOduration=1.992096579 podStartE2EDuration="1.992096579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:15:08.990144025 +0000 UTC m=+2087.525027012" watchObservedRunningTime="2026-07-18 01:15:08.992096579 +0000 UTC m=+2087.526979562" Jul 18 01:15:18.048477 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:18.048442 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:18.049026 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:18.048510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:18.061658 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:18.061632 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:19.038766 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:19.038733 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:25.950129 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:25.950094 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:15:27.025741 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:27.025693 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:37.715743 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:37.715711 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:15:37.717671 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:37.717647 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:15:40.972036 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:40.971996 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" podUID="e7867334-ec7e-49e1-a0e0-8ada678d2383" containerName="main" containerID="cri-o://dc63c051f551408d481a34ffea894a93fbf9d0cabf57e4053ed63ee668976061" gracePeriod=45 Jul 18 01:15:41.150752 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.150717 2577 generic.go:356] "Generic (PLEG): container finished" podID="e7867334-ec7e-49e1-a0e0-8ada678d2383" containerID="dc63c051f551408d481a34ffea894a93fbf9d0cabf57e4053ed63ee668976061" exitCode=0 Jul 18 01:15:41.150916 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.150782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" event={"ID":"e7867334-ec7e-49e1-a0e0-8ada678d2383","Type":"ContainerDied","Data":"dc63c051f551408d481a34ffea894a93fbf9d0cabf57e4053ed63ee668976061"} Jul 18 01:15:41.228149 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.228080 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:15:41.288707 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm2nf\" (UniqueName: \"kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.288876 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288727 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.288876 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.288876 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288811 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.288876 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288839 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.289101 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.288921 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache\") pod \"e7867334-ec7e-49e1-a0e0-8ada678d2383\" (UID: \"e7867334-ec7e-49e1-a0e0-8ada678d2383\") " Jul 18 01:15:41.289101 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.289018 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home" (OuterVolumeSpecName: "home") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:41.289213 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.289187 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:41.289270 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.289249 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache" (OuterVolumeSpecName: "model-cache") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:41.289340 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.289321 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-home\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:41.289397 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.289345 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-tmp-dir\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:41.291146 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.291122 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm" (OuterVolumeSpecName: "dshm") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:41.291274 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.291169 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf" (OuterVolumeSpecName: "kube-api-access-qm2nf") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "kube-api-access-qm2nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:15:41.291274 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.291239 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e7867334-ec7e-49e1-a0e0-8ada678d2383" (UID: "e7867334-ec7e-49e1-a0e0-8ada678d2383"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:15:41.390533 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.390479 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-model-cache\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:41.390533 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.390524 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm2nf\" (UniqueName: \"kubernetes.io/projected/e7867334-ec7e-49e1-a0e0-8ada678d2383-kube-api-access-qm2nf\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:41.390533 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.390533 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7867334-ec7e-49e1-a0e0-8ada678d2383-tls-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:41.390533 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:41.390543 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7867334-ec7e-49e1-a0e0-8ada678d2383-dshm\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.047535 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.047470 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" podUID="1fb44f13-c39f-4108-9465-aecce26ede66" containerName="main" containerID="cri-o://14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04" gracePeriod=45 Jul 18 01:15:42.157378 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.157350 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" Jul 18 01:15:42.157571 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.157349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck" event={"ID":"e7867334-ec7e-49e1-a0e0-8ada678d2383","Type":"ContainerDied","Data":"aee1aa19698c4502263cc2c55454bef3cbe1709664cf31a0e57ba0cfa495948a"} Jul 18 01:15:42.157571 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.157502 2577 scope.go:117] "RemoveContainer" containerID="dc63c051f551408d481a34ffea894a93fbf9d0cabf57e4053ed63ee668976061" Jul 18 01:15:42.176808 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.176775 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:15:42.180702 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.180673 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9d3231/test-model-9d3231-kserve-6684bc6569-ktqck"] Jul 18 01:15:42.321478 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.321452 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:42.400825 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400793 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401016 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400838 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401016 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400869 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401016 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400887 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp4rf\" (UniqueName: \"kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401016 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400951 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401016 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.400991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm\") pod \"1fb44f13-c39f-4108-9465-aecce26ede66\" (UID: \"1fb44f13-c39f-4108-9465-aecce26ede66\") " Jul 18 01:15:42.401305 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401101 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home" (OuterVolumeSpecName: "home") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:42.401305 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401221 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:42.401305 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401232 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache" (OuterVolumeSpecName: "model-cache") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:42.401424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401379 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-tmp-dir\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.401424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401396 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-home\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.401424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.401410 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-model-cache\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.403431 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.403399 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm" (OuterVolumeSpecName: "dshm") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:15:42.403570 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.403448 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:15:42.403570 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.403472 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf" (OuterVolumeSpecName: "kube-api-access-tp4rf") pod "1fb44f13-c39f-4108-9465-aecce26ede66" (UID: "1fb44f13-c39f-4108-9465-aecce26ede66"). InnerVolumeSpecName "kube-api-access-tp4rf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:15:42.502424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.502332 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb44f13-c39f-4108-9465-aecce26ede66-dshm\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.502424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.502362 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb44f13-c39f-4108-9465-aecce26ede66-tls-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:42.502424 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:42.502373 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp4rf\" (UniqueName: \"kubernetes.io/projected/1fb44f13-c39f-4108-9465-aecce26ede66-kube-api-access-tp4rf\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:15:43.171542 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.171476 2577 generic.go:356] "Generic (PLEG): container finished" podID="1fb44f13-c39f-4108-9465-aecce26ede66" containerID="14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04" exitCode=0 Jul 18 01:15:43.172062 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.171552 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" Jul 18 01:15:43.172062 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.171582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" event={"ID":"1fb44f13-c39f-4108-9465-aecce26ede66","Type":"ContainerDied","Data":"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04"} Jul 18 01:15:43.172062 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.171633 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb" event={"ID":"1fb44f13-c39f-4108-9465-aecce26ede66","Type":"ContainerDied","Data":"d0b2d16621f232a292fb1e3c414fa5a33def170b88b0c9f302d11239c997ea7e"} Jul 18 01:15:43.172062 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.171655 2577 scope.go:117] "RemoveContainer" containerID="14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04" Jul 18 01:15:43.182176 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.182152 2577 scope.go:117] "RemoveContainer" containerID="14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04" Jul 18 01:15:43.182515 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:15:43.182471 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04\": container with ID starting with 14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04 not found: ID does not exist" containerID="14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04" Jul 18 01:15:43.182629 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.182541 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04"} err="failed to get container status \"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04\": rpc error: code = NotFound desc = could not find container \"14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04\": container with ID starting with 14976fdaf8dee33048a989bb8222bb0ce90096c234393228ac8cc4adef062d04 not found: ID does not exist" Jul 18 01:15:43.194789 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.194756 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:43.197038 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.197011 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b13551/test-model-b13551-kserve-54d6fdc575-pxmqb"] Jul 18 01:15:43.966780 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.966745 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb44f13-c39f-4108-9465-aecce26ede66" path="/var/lib/kubelet/pods/1fb44f13-c39f-4108-9465-aecce26ede66/volumes" Jul 18 01:15:43.967163 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:15:43.967149 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7867334-ec7e-49e1-a0e0-8ada678d2383" path="/var/lib/kubelet/pods/e7867334-ec7e-49e1-a0e0-8ada678d2383/volumes" Jul 18 01:16:16.619419 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:16.619324 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:16:16.620092 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:16.619582 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" containerID="cri-o://953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7" gracePeriod=30 Jul 18 01:16:19.854241 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:19.854202 2577 patch_prober.go:28] interesting pod/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 01:16:19.854684 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:19.854282 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 01:16:21.890619 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.890542 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:16:21.974467 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974430 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974467 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974473 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974511 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974555 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974603 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4228t\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974642 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974672 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974737 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974740 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:21.974849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974761 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token\") pod \"93f24a75-444f-480f-8989-1a97febbd7e9\" (UID: \"93f24a75-444f-480f-8989-1a97febbd7e9\") " Jul 18 01:16:21.975252 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.974974 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:21.975252 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975015 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:16:21.975252 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975162 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93f24a75-444f-480f-8989-1a97febbd7e9-istiod-ca-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:21.975252 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975180 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:21.975252 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975192 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-workload-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:21.975564 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975433 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:21.975564 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.975444 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:21.977044 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.977018 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t" (OuterVolumeSpecName: "kube-api-access-4228t") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "kube-api-access-4228t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:21.977444 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.977426 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:16:21.977576 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.977446 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:21.977726 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:21.977697 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "93f24a75-444f-480f-8989-1a97febbd7e9" (UID: "93f24a75-444f-480f-8989-1a97febbd7e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:22.075680 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075639 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-envoy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.075680 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075671 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4228t\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-kube-api-access-4228t\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.075680 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075682 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-credential-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.075680 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075693 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93f24a75-444f-480f-8989-1a97febbd7e9-istio-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.075998 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075702 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93f24a75-444f-480f-8989-1a97febbd7e9-istio-podinfo\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.075998 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.075710 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93f24a75-444f-480f-8989-1a97febbd7e9-istio-data\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:16:22.397323 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.397290 2577 generic.go:356] "Generic (PLEG): container finished" podID="93f24a75-444f-480f-8989-1a97febbd7e9" containerID="953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7" exitCode=0 Jul 18 01:16:22.397537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.397343 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" Jul 18 01:16:22.397537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.397378 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerDied","Data":"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7"} Jul 18 01:16:22.397537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.397426 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv" event={"ID":"93f24a75-444f-480f-8989-1a97febbd7e9","Type":"ContainerDied","Data":"2a036cac1f1c6a4d09cc6be7f241825b79e4e9abedce9e7899be2daab796ff19"} Jul 18 01:16:22.397537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.397450 2577 scope.go:117] "RemoveContainer" containerID="953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7" Jul 18 01:16:22.407233 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.407214 2577 scope.go:117] "RemoveContainer" containerID="34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c" Jul 18 01:16:22.416772 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.416748 2577 scope.go:117] "RemoveContainer" containerID="953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7" Jul 18 01:16:22.417217 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:16:22.417139 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7\": container with ID starting with 953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7 not found: ID does not exist" containerID="953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7" Jul 18 01:16:22.417345 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.417245 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7"} err="failed to get container status \"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7\": rpc error: code = NotFound desc = could not find container \"953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7\": container with ID starting with 953bd6e5149e3aa5118faad61440be88e7a22f50e9f1edbcdb0fb68eef0a69a7 not found: ID does not exist" Jul 18 01:16:22.417345 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.417270 2577 scope.go:117] "RemoveContainer" containerID="34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c" Jul 18 01:16:22.417916 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:16:22.417877 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c\": container with ID starting with 34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c not found: ID does not exist" containerID="34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c" Jul 18 01:16:22.418099 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.417925 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c"} err="failed to get container status \"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c\": rpc error: code = NotFound desc = could not find container \"34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c\": container with ID starting with 34b7ba069b812b1b6bc906e4deefccd2d5ae7bf6e0582448ac84ba0b32e5905c not found: ID does not exist" Jul 18 01:16:22.420723 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.420702 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:16:22.424857 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:22.424830 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b13551-openshift-default-5bdd9c7497-g62kv"] Jul 18 01:16:23.966418 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:23.966385 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" path="/var/lib/kubelet/pods/93f24a75-444f-480f-8989-1a97febbd7e9/volumes" Jul 18 01:16:26.312224 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312180 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312632 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312644 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312652 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb44f13-c39f-4108-9465-aecce26ede66" containerName="main" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312658 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb44f13-c39f-4108-9465-aecce26ede66" containerName="main" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312672 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7867334-ec7e-49e1-a0e0-8ada678d2383" containerName="main" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312678 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7867334-ec7e-49e1-a0e0-8ada678d2383" containerName="main" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312694 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312699 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312758 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7867334-ec7e-49e1-a0e0-8ada678d2383" containerName="main" Jul 18 01:16:26.312758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312764 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb44f13-c39f-4108-9465-aecce26ede66" containerName="main" Jul 18 01:16:26.313318 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312770 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.313318 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.312776 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f24a75-444f-480f-8989-1a97febbd7e9" containerName="istio-proxy" Jul 18 01:16:26.315982 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.315958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.318966 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.318939 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:16:26.319137 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.319113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a6b1e0-openshift-default-dockercfg-v5vc6\"" Jul 18 01:16:26.326427 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.326394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:16:26.420017 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.419972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420017 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzs5d\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.420306 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.420252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521314 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521556 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521523 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzs5d\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521815 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.521890 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.521859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.522099 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.522033 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.522206 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.522182 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.522446 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.522417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.524117 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.524087 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.524216 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.524193 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.530350 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.530313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.530662 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.530641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzs5d\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d\") pod \"e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.627907 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.627811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:26.800924 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.800885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:16:26.801909 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:16:26.801880 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7a0c5e_496d_4685_ac72_d93c330c9bca.slice/crio-1df359682b587b9bf108f83c048773fbbdcf90b6b325521b43c05b83327bcbb5 WatchSource:0}: Error finding container 1df359682b587b9bf108f83c048773fbbdcf90b6b325521b43c05b83327bcbb5: Status 404 returned error can't find the container with id 1df359682b587b9bf108f83c048773fbbdcf90b6b325521b43c05b83327bcbb5 Jul 18 01:16:26.804339 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.804301 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:26.804456 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.804391 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:26.804456 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:26.804436 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:27.424993 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:27.424955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerStarted","Data":"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b"} Jul 18 01:16:27.425432 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:27.425017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerStarted","Data":"1df359682b587b9bf108f83c048773fbbdcf90b6b325521b43c05b83327bcbb5"} Jul 18 01:16:27.447648 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:27.447588 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podStartSLOduration=1.447570915 podStartE2EDuration="1.447570915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:16:27.445037703 +0000 UTC m=+2165.979920739" watchObservedRunningTime="2026-07-18 01:16:27.447570915 +0000 UTC m=+2165.982453903" Jul 18 01:16:27.627987 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:27.627929 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:27.632866 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:27.632838 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:28.430617 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:28.430590 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:28.431750 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:28.431731 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:42.515350 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.515252 2577 generic.go:356] "Generic (PLEG): container finished" podID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerID="f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b" exitCode=0 Jul 18 01:16:42.515350 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.515293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerDied","Data":"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b"} Jul 18 01:16:42.515966 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.515946 2577 scope.go:117] "RemoveContainer" containerID="f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b" Jul 18 01:16:42.517071 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.517035 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:42.517173 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.517130 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:42.517235 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:42.517178 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:16:43.431275 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:43.431221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:43.522620 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:43.522589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerStarted","Data":"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c"} Jul 18 01:16:43.628242 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:43.628205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:43.629242 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:43.629211 2577 patch_prober.go:28] interesting pod/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 18 01:16:43.629381 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:43.629269 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 18 01:16:44.628326 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:44.628286 2577 patch_prober.go:28] interesting pod/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 18 01:16:44.628781 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:44.628346 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 18 01:16:45.629178 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:45.629138 2577 patch_prober.go:28] interesting pod/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 18 01:16:45.629710 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:45.629211 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 18 01:16:46.628747 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:46.628702 2577 patch_prober.go:28] interesting pod/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 18 01:16:46.628969 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:46.628762 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 18 01:16:47.632902 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:47.632872 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:47.633397 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:47.633272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:47.633849 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:47.633827 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:16:55.296163 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:55.296122 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:16:55.296803 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:16:55.296360 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" containerID="cri-o://b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c" gracePeriod=30 Jul 18 01:17:00.550604 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.550577 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:17:00.616805 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.616712 2577 generic.go:356] "Generic (PLEG): container finished" podID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerID="b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c" exitCode=0 Jul 18 01:17:00.616805 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.616775 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" Jul 18 01:17:00.616999 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.616806 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerDied","Data":"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c"} Jul 18 01:17:00.616999 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.616871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx" event={"ID":"3c7a0c5e-496d-4685-ac72-d93c330c9bca","Type":"ContainerDied","Data":"1df359682b587b9bf108f83c048773fbbdcf90b6b325521b43c05b83327bcbb5"} Jul 18 01:17:00.616999 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.616902 2577 scope.go:117] "RemoveContainer" containerID="b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c" Jul 18 01:17:00.626295 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.626272 2577 scope.go:117] "RemoveContainer" containerID="f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b" Jul 18 01:17:00.635180 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.635163 2577 scope.go:117] "RemoveContainer" containerID="b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c" Jul 18 01:17:00.635452 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:17:00.635432 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c\": container with ID starting with b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c not found: ID does not exist" containerID="b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c" Jul 18 01:17:00.635555 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.635467 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c"} err="failed to get container status \"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c\": rpc error: code = NotFound desc = could not find container \"b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c\": container with ID starting with b05e61c02baeb71f5c8dc76c2e851ee95afc188b176ff6d43209b344da89488c not found: ID does not exist" Jul 18 01:17:00.635555 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.635521 2577 scope.go:117] "RemoveContainer" containerID="f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b" Jul 18 01:17:00.636777 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:17:00.636230 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b\": container with ID starting with f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b not found: ID does not exist" containerID="f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b" Jul 18 01:17:00.636777 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.636264 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b"} err="failed to get container status \"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b\": rpc error: code = NotFound desc = could not find container \"f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b\": container with ID starting with f2a3a3aba1b395c1156dd086b96929712935a11a26b633989adb2832d730739b not found: ID does not exist" Jul 18 01:17:00.650618 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650586 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.650767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650630 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.650767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650665 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.650767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650693 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.650767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650726 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzs5d\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.650767 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650752 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.651006 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650792 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.651006 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650822 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.651006 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.650877 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket\") pod \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\" (UID: \"3c7a0c5e-496d-4685-ac72-d93c330c9bca\") " Jul 18 01:17:00.651155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.651094 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:17:00.651155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.651141 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:17:00.651345 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.651272 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:17:00.651478 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.651416 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:17:00.651741 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.651717 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:17:00.653028 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.653000 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:17:00.653293 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.653267 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:17:00.653604 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.653586 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d" (OuterVolumeSpecName: "kube-api-access-nzs5d") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "kube-api-access-nzs5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:17:00.653668 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.653582 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c7a0c5e-496d-4685-ac72-d93c330c9bca" (UID: "3c7a0c5e-496d-4685-ac72-d93c330c9bca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:17:00.752398 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752359 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752398 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752388 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istiod-ca-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752398 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752397 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-credential-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752398 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752406 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-podinfo\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752415 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-data\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752422 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-istio-envoy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752430 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752438 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzs5d\" (UniqueName: \"kubernetes.io/projected/3c7a0c5e-496d-4685-ac72-d93c330c9bca-kube-api-access-nzs5d\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.752709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.752446 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c7a0c5e-496d-4685-ac72-d93c330c9bca-workload-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:17:00.940357 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.940312 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:17:00.943870 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:00.943842 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a6b1e0-openshift-default-7bf8f5b7-j5fkx"] Jul 18 01:17:01.968841 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:01.968798 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" path="/var/lib/kubelet/pods/3c7a0c5e-496d-4685-ac72-d93c330c9bca/volumes" Jul 18 01:17:04.297305 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297269 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:17:04.297708 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297691 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:17:04.297708 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297703 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:17:04.297787 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297713 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:17:04.297787 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297721 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:17:04.297787 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.297780 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:17:04.302368 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.302348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.305461 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.305434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-0f09f3-openshift-default-dockercfg-f757c\"" Jul 18 01:17:04.305716 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.305695 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:17:04.314045 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.314014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:17:04.388214 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388395 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388395 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388395 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388345 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388395 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388567 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388567 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388567 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.388662 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.388576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcng\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489709 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcng\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489905 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.489980 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490246 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.489983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490537 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.490510 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490711 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.490560 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490777 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.490567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490777 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.490598 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.490777 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.490764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.492371 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.492346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.492781 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.492761 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.523148 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.523109 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.523301 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.523279 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcng\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng\") pod \"e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.616783 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.616739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:04.765627 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.765601 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:17:04.766987 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:17:04.766959 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bef6ee7_ea2f_4482_a1f3_48ebd2ebb870.slice/crio-620f0b3dc049e6b04063015a6c39f0e09bb345ef97a4f462be0bbbf99e0059a6 WatchSource:0}: Error finding container 620f0b3dc049e6b04063015a6c39f0e09bb345ef97a4f462be0bbbf99e0059a6: Status 404 returned error can't find the container with id 620f0b3dc049e6b04063015a6c39f0e09bb345ef97a4f462be0bbbf99e0059a6 Jul 18 01:17:04.769105 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.769068 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:04.769229 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.769155 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:04.769229 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:04.769210 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:05.648108 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:05.648053 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerStarted","Data":"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb"} Jul 18 01:17:05.648535 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:05.648127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerStarted","Data":"620f0b3dc049e6b04063015a6c39f0e09bb345ef97a4f462be0bbbf99e0059a6"} Jul 18 01:17:05.674588 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:05.674532 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podStartSLOduration=1.674513328 podStartE2EDuration="1.674513328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:17:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:17:05.672714363 +0000 UTC m=+2204.207597351" watchObservedRunningTime="2026-07-18 01:17:05.674513328 +0000 UTC m=+2204.209396315" Jul 18 01:17:06.617838 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:06.617797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:06.623520 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:06.623473 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:06.653862 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:06.653829 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:06.654842 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:06.654822 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:22.695687 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:22.695643 2577 patch_prober.go:28] interesting pod/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 01:17:22.696165 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:22.695729 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 01:17:23.749987 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.749950 2577 generic.go:356] "Generic (PLEG): container finished" podID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerID="d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb" exitCode=0 Jul 18 01:17:23.750444 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.750027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerDied","Data":"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb"} Jul 18 01:17:23.750561 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.750545 2577 scope.go:117] "RemoveContainer" containerID="d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb" Jul 18 01:17:23.751668 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.751636 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:23.751758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.751730 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:23.751796 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:23.751783 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 18 01:17:24.757618 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:24.757579 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerStarted","Data":"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85"} Jul 18 01:17:25.617413 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:25.617366 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:25.617696 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:25.617669 2577 patch_prober.go:28] interesting pod/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 18 01:17:25.617794 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:25.617731 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 18 01:17:26.617903 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:26.617866 2577 patch_prober.go:28] interesting pod/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 18 01:17:26.618322 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:26.617923 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 18 01:17:27.617300 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:27.617262 2577 patch_prober.go:28] interesting pod/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 18 01:17:27.617464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:27.617321 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 18 01:17:28.618264 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:28.618221 2577 patch_prober.go:28] interesting pod/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 18 01:17:28.618796 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:28.618298 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 18 01:17:29.620791 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:29.620753 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:29.621244 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:29.621062 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:17:29.621918 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:17:29.621902 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:20:30.798005 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:30.797969 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:20:30.798530 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:30.798212 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" containerID="cri-o://4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85" gracePeriod=30 Jul 18 01:20:36.047615 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.047583 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:20:36.092732 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092628 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092732 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092695 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092818 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092880 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092928 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092925 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.092974 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftcng\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.093299 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.092980 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.093299 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.093011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket\") pod \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\" (UID: \"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870\") " Jul 18 01:20:36.093299 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.093118 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:36.093719 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.093371 2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-certs\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.093719 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.093392 2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-credential-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.093847 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.093768 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:36.094155 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.094126 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:20:36.094395 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.094372 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:36.095347 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.095316 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:20:36.095464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.095357 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:20:36.095464 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.095398 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:36.095740 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.095723 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng" (OuterVolumeSpecName: "kube-api-access-ftcng") pod "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" (UID: "7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870"). InnerVolumeSpecName "kube-api-access-ftcng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:20:36.194443 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194402 2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-podinfo\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194443 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194435 2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-data\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194443 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194447 2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-token\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194443 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194455 2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istiod-ca-cert\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194778 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194463 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftcng\" (UniqueName: \"kubernetes.io/projected/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-kube-api-access-ftcng\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194778 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194473 2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-istio-envoy\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.194778 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.194513 2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870-workload-socket\") on node \"ip-10-0-136-82.ec2.internal\" DevicePath \"\"" Jul 18 01:20:36.815697 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.815659 2577 generic.go:356] "Generic (PLEG): container finished" podID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerID="4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85" exitCode=0 Jul 18 01:20:36.815897 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.815712 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" Jul 18 01:20:36.815897 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.815741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerDied","Data":"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85"} Jul 18 01:20:36.815897 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.815800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm" event={"ID":"7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870","Type":"ContainerDied","Data":"620f0b3dc049e6b04063015a6c39f0e09bb345ef97a4f462be0bbbf99e0059a6"} Jul 18 01:20:36.815897 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.815832 2577 scope.go:117] "RemoveContainer" containerID="4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85" Jul 18 01:20:36.825976 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.825956 2577 scope.go:117] "RemoveContainer" containerID="d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb" Jul 18 01:20:36.835187 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.835167 2577 scope.go:117] "RemoveContainer" containerID="4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85" Jul 18 01:20:36.835517 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:20:36.835473 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85\": container with ID starting with 4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85 not found: ID does not exist" containerID="4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85" Jul 18 01:20:36.835620 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.835530 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85"} err="failed to get container status \"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85\": rpc error: code = NotFound desc = could not find container \"4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85\": container with ID starting with 4009407219ef44aadf27189b88905cb92586b45b0130945edbf83d4c4e82bc85 not found: ID does not exist" Jul 18 01:20:36.835620 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.835551 2577 scope.go:117] "RemoveContainer" containerID="d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb" Jul 18 01:20:36.835821 ip-10-0-136-82 kubenswrapper[2577]: E0718 01:20:36.835804 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb\": container with ID starting with d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb not found: ID does not exist" containerID="d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb" Jul 18 01:20:36.835861 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.835829 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb"} err="failed to get container status \"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb\": rpc error: code = NotFound desc = could not find container \"d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb\": container with ID starting with d8ec4405fe16bf804f24bda17feeca83895fcd4bb5daaba58cb4fa8de7e681eb not found: ID does not exist" Jul 18 01:20:36.840277 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.840248 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:20:36.845020 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.844984 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-0f09f3-openshift-default-589d4847c9-mhwbm"] Jul 18 01:20:36.969812 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.969781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-jt6th_d560c2e9-1b20-4e1b-baea-fb4e10de8698/copy-manifests/0.log" Jul 18 01:20:36.997712 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:36.997679 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-jt6th_d560c2e9-1b20-4e1b-baea-fb4e10de8698/manager/0.log" Jul 18 01:20:37.753049 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.753023 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:20:37.755893 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.755871 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:20:37.884659 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.884634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/util/0.log" Jul 18 01:20:37.891633 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.891611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/pull/0.log" Jul 18 01:20:37.898117 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.898100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/extract/0.log" Jul 18 01:20:37.965560 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:37.965526 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" path="/var/lib/kubelet/pods/7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870/volumes" Jul 18 01:20:38.010400 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.010323 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/util/0.log" Jul 18 01:20:38.017635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.017612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/pull/0.log" Jul 18 01:20:38.024906 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.024885 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/extract/0.log" Jul 18 01:20:38.141523 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.141474 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/util/0.log" Jul 18 01:20:38.148148 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.148126 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/pull/0.log" Jul 18 01:20:38.154721 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.154698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/extract/0.log" Jul 18 01:20:38.264989 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.264910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/pull/0.log" Jul 18 01:20:38.270720 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.270700 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/extract/0.log" Jul 18 01:20:38.276458 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.276433 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/util/0.log" Jul 18 01:20:38.747860 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:38.747832 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dmhph_d0f1d80e-05c2-40d4-854a-8ab86da189b0/kuadrant-console-plugin/0.log" Jul 18 01:20:39.815997 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:39.815967 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-bfjs9_cf81154f-53ab-4393-9c32-68bc474332bd/kube-auth-proxy/0.log" Jul 18 01:20:40.739385 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:40.739357 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-88xms_71930899-3e9a-47a2-8609-2c491b44dd7e/main/0.log" Jul 18 01:20:41.079875 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:41.079847 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8ss_18703124-4575-4418-9a9d-2fd07756dbb1/main/0.log" Jul 18 01:20:48.340982 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:48.340887 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kwvtd_21bc05e7-e356-4707-b3e4-b336dc39e1da/global-pull-secret-syncer/0.log" Jul 18 01:20:48.520409 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:48.520378 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tcwbt_e6745688-c862-4ba3-bbd2-6a5cb0335dde/konnectivity-agent/0.log" Jul 18 01:20:48.572446 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:48.572417 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-82.ec2.internal_e2b1c5a1c951ba2dea802fc68a7b0c0f/haproxy/0.log" Jul 18 01:20:52.843645 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.843619 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/extract/0.log" Jul 18 01:20:52.874291 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.874264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/util/0.log" Jul 18 01:20:52.899354 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.899325 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759bttvt_9ae67d92-bef5-4dce-aedf-ed6d5c8130af/pull/0.log" Jul 18 01:20:52.929852 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.929819 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/extract/0.log" Jul 18 01:20:52.951722 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.951694 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/util/0.log" Jul 18 01:20:52.974708 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:52.974664 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kbds9_51b5e77f-9afd-4202-8429-52c2a652aad6/pull/0.log" Jul 18 01:20:53.007440 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.007408 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/extract/0.log" Jul 18 01:20:53.050813 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.050782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/util/0.log" Jul 18 01:20:53.108312 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.108218 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fn47b_83d17b16-8f58-488e-a404-2d70001066d5/pull/0.log" Jul 18 01:20:53.177412 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.177386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/extract/0.log" Jul 18 01:20:53.205885 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.205854 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/util/0.log" Jul 18 01:20:53.235105 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.235074 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16dpqg_77411d0d-89bf-49cd-9bf3-1118a825593d/pull/0.log" Jul 18 01:20:53.696049 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:53.696024 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-dmhph_d0f1d80e-05c2-40d4-854a-8ab86da189b0/kuadrant-console-plugin/0.log" Jul 18 01:20:55.653635 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.653549 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/alertmanager/0.log" Jul 18 01:20:55.679346 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.679310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/config-reloader/0.log" Jul 18 01:20:55.702383 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.702335 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/kube-rbac-proxy-web/0.log" Jul 18 01:20:55.723592 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.723568 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/kube-rbac-proxy/0.log" Jul 18 01:20:55.746119 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.746078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/kube-rbac-proxy-metric/0.log" Jul 18 01:20:55.768090 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.768064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/prom-label-proxy/0.log" Jul 18 01:20:55.800639 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.800611 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c9dde765-c901-4474-bdaf-d75e8e6f9492/init-config-reloader/0.log" Jul 18 01:20:55.874892 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.874859 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pmknx_e65e9145-3e90-498a-9e42-b7d57845eee4/kube-state-metrics/0.log" Jul 18 01:20:55.895612 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.895586 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pmknx_e65e9145-3e90-498a-9e42-b7d57845eee4/kube-rbac-proxy-main/0.log" Jul 18 01:20:55.920494 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:55.920397 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-pmknx_e65e9145-3e90-498a-9e42-b7d57845eee4/kube-rbac-proxy-self/0.log" Jul 18 01:20:56.114294 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.114264 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrjsl_3c5d1b0c-780c-4338-a03d-2444e50813a2/node-exporter/0.log" Jul 18 01:20:56.136758 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.136730 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrjsl_3c5d1b0c-780c-4338-a03d-2444e50813a2/kube-rbac-proxy/0.log" Jul 18 01:20:56.158008 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.157984 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lrjsl_3c5d1b0c-780c-4338-a03d-2444e50813a2/init-textfile/0.log" Jul 18 01:20:56.535441 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.535399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-d7zws_3aa43206-9ab1-498e-919c-db65a8e8a45c/prometheus-operator/0.log" Jul 18 01:20:56.560564 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.560534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-d7zws_3aa43206-9ab1-498e-919c-db65a8e8a45c/kube-rbac-proxy/0.log" Jul 18 01:20:56.586765 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:56.586737 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-h2r8r_24442f34-21be-4afd-8e8b-54895e8db643/prometheus-operator-admission-webhook/0.log" Jul 18 01:20:57.975535 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:57.975507 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-v2jfq_7811bca7-53b7-455a-8a24-ac1f41c9d47c/networking-console-plugin/0.log" Jul 18 01:20:58.290151 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290057 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk"] Jul 18 01:20:58.290431 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290419 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" Jul 18 01:20:58.290475 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290433 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" Jul 18 01:20:58.290475 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290453 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" Jul 18 01:20:58.290475 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290459 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" Jul 18 01:20:58.290596 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290559 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bef6ee7-ea2f-4482-a1f3-48ebd2ebb870" containerName="istio-proxy" Jul 18 01:20:58.290596 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.290570 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7a0c5e-496d-4685-ac72-d93c330c9bca" containerName="istio-proxy" Jul 18 01:20:58.293640 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.293619 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.296574 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.296548 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"openshift-service-ca.crt\"" Jul 18 01:20:58.296747 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.296620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z5qjz\"/\"default-dockercfg-k524g\"" Jul 18 01:20:58.297864 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.297846 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"kube-root-ca.crt\"" Jul 18 01:20:58.305545 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.305511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk"] Jul 18 01:20:58.409563 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.409517 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-sys\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.409759 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.409578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-lib-modules\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.409759 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.409644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-podres\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.409759 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.409674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-proc\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.409759 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.409709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6f2w\" (UniqueName: \"kubernetes.io/projected/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-kube-api-access-d6f2w\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510352 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6f2w\" (UniqueName: \"kubernetes.io/projected/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-kube-api-access-d6f2w\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510586 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-sys\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510586 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-lib-modules\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510586 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-podres\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510586 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510463 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-proc\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510586 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-sys\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510820 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510589 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-proc\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510820 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510624 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-lib-modules\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.510820 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.510629 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-podres\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.519500 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.519463 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6f2w\" (UniqueName: \"kubernetes.io/projected/9fa57b94-da3c-43d4-9e71-c84ecd9afd14-kube-api-access-d6f2w\") pod \"perf-node-gather-daemonset-6zvjk\" (UID: \"9fa57b94-da3c-43d4-9e71-c84ecd9afd14\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.605631 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.605586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.641503 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.641453 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/1.log" Jul 18 01:20:58.647077 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.647047 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-n2ttf_83cee856-e824-4f02-9537-e16892f2ecfa/console-operator/2.log" Jul 18 01:20:58.753739 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.753602 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk"] Jul 18 01:20:58.756664 ip-10-0-136-82 kubenswrapper[2577]: W0718 01:20:58.756632 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fa57b94_da3c_43d4_9e71_c84ecd9afd14.slice/crio-a91f11c8d0b393281341e8867283a8c3b742d34be89f1a9a0e71774e43463fce WatchSource:0}: Error finding container a91f11c8d0b393281341e8867283a8c3b742d34be89f1a9a0e71774e43463fce: Status 404 returned error can't find the container with id a91f11c8d0b393281341e8867283a8c3b742d34be89f1a9a0e71774e43463fce Jul 18 01:20:58.941019 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.940976 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" event={"ID":"9fa57b94-da3c-43d4-9e71-c84ecd9afd14","Type":"ContainerStarted","Data":"ca236c9feb2e609e40935bf25b67e61415a75eefb819642965acc5d11a859a40"} Jul 18 01:20:58.941019 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.941040 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:20:58.941019 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.941064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" event={"ID":"9fa57b94-da3c-43d4-9e71-c84ecd9afd14","Type":"ContainerStarted","Data":"a91f11c8d0b393281341e8867283a8c3b742d34be89f1a9a0e71774e43463fce"} Jul 18 01:20:58.963852 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:58.963800 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" podStartSLOduration=0.963783244 podStartE2EDuration="963.783244ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:20:58.96293565 +0000 UTC m=+2437.497818639" watchObservedRunningTime="2026-07-18 01:20:58.963783244 +0000 UTC m=+2437.498666230" Jul 18 01:20:59.211077 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:59.210992 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56d77cb5cf-25z54_4ee5155d-985f-44c7-97b2-9577492bad6d/console/0.log" Jul 18 01:20:59.246328 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:59.246295 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-dj9rd_9743e3b0-ee06-4b26-9c3a-3e336c509589/download-server/0.log" Jul 18 01:20:59.841139 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:20:59.841111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-9wz6f_07e66ac7-bace-49c3-a127-f0e964254842/volume-data-source-validator/0.log" Jul 18 01:21:00.976671 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:00.976642 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vhcnk_ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d/dns/0.log" Jul 18 01:21:01.000159 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:01.000134 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vhcnk_ce0cfea2-159b-4b2d-b96c-c905bd4fbd4d/kube-rbac-proxy/0.log" Jul 18 01:21:01.077407 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:01.077376 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znnm9_d37bdffd-cc3a-4caf-a1ae-807aa5d9e6f5/dns-node-resolver/0.log" Jul 18 01:21:01.685877 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:01.685848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slv4q_123ca7fe-59f2-4012-88f1-a755b47e1ffb/node-ca/0.log" Jul 18 01:21:02.805528 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:02.805471 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-bfjs9_cf81154f-53ab-4393-9c32-68bc474332bd/kube-auth-proxy/0.log" Jul 18 01:21:03.717359 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:03.717331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-btfk5_4d312b42-1264-40e8-95be-91339ee220a0/serve-healthcheck-canary/0.log" Jul 18 01:21:04.247665 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.247626 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v5krs_88bb9703-f81d-4a45-923f-f5829f881497/insights-operator/0.log" Jul 18 01:21:04.248194 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.248176 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-v5krs_88bb9703-f81d-4a45-923f-f5829f881497/insights-operator/1.log" Jul 18 01:21:04.268656 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.268627 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8rhv_a2407c6a-3d22-4362-aacb-cced3e94b87f/kube-rbac-proxy/0.log" Jul 18 01:21:04.290913 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.290884 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8rhv_a2407c6a-3d22-4362-aacb-cced3e94b87f/exporter/0.log" Jul 18 01:21:04.313574 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.313547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d8rhv_a2407c6a-3d22-4362-aacb-cced3e94b87f/extractor/0.log" Jul 18 01:21:04.957688 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:04.957663 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-6zvjk" Jul 18 01:21:07.117617 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:07.117590 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-jt6th_d560c2e9-1b20-4e1b-baea-fb4e10de8698/manager/0.log" Jul 18 01:21:07.154936 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:07.154909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-jt6th_d560c2e9-1b20-4e1b-baea-fb4e10de8698/copy-manifests/0.log" Jul 18 01:21:08.818765 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:08.818733 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fb6694444-s5q2b_495c52f5-7477-4f6d-b252-b28b8fa246dd/manager/0.log" Jul 18 01:21:08.843861 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:08.843830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9s5zn_02f0f888-fc1a-47cd-880e-5a145c3c11c8/openshift-lws-operator/0.log" Jul 18 01:21:09.050503 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:09.050391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-bfjs9_cf81154f-53ab-4393-9c32-68bc474332bd/kube-auth-proxy/0.log" Jul 18 01:21:10.523498 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:10.523466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54498b876f-bfjs9_cf81154f-53ab-4393-9c32-68bc474332bd/kube-auth-proxy/0.log" Jul 18 01:21:13.982702 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:13.982677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-d4flp_e28f1e21-f507-40a4-8726-67e06a674f81/migrator/0.log" Jul 18 01:21:14.008548 ip-10-0-136-82 kubenswrapper[2577]: I0718 01:21:14.008520 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-d4flp_e28f1e21-f507-40a4-8726-67e06a674f81/graceful-termination/0.log"