Jul 09 14:37:52.110575 ip-10-0-140-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 14:37:52.110589 ip-10-0-140-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 14:37:52.110598 ip-10-0-140-95 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 14:37:52.111026 ip-10-0-140-95 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 14:38:02.295065 ip-10-0-140-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 14:38:02.295084 ip-10-0-140-95 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9dbbcbdea0a4493b94218af0ad57d475 -- Jul 09 14:40:08.565048 ip-10-0-140-95 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:40:09.004080 ip-10-0-140-95 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:40:09.004080 ip-10-0-140-95 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:40:09.004080 ip-10-0-140-95 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:40:09.004080 ip-10-0-140-95 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:40:09.004080 ip-10-0-140-95 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:40:09.005250 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.005114 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:40:09.009695 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009675 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.009695 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009695 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009699 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009702 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009704 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009708 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009711 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009731 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009735 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009737 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009740 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009742 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009745 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009748 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009751 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009754 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009757 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009759 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009762 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009764 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009767 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.009778 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009769 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009772 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009774 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009777 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009780 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009783 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009786 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009789 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009798 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009803 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009806 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009808 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009811 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009815 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009819 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009823 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009825 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009829 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009832 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009834 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.010285 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009837 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009840 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009845 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009849 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009852 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009855 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009860 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009864 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009867 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009870 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009872 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009875 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009877 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009880 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009884 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009886 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009889 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009892 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009895 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.011064 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009897 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009900 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009902 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009906 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009909 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009911 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009913 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009916 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009919 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009922 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009925 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009927 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009930 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009933 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009935 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009937 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009940 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009942 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009945 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009947 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.011540 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009950 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009953 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009956 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009958 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009960 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009963 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009965 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009970 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009973 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009975 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009978 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009981 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009983 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009986 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009988 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009991 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009994 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009996 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.012119 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.009999 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.013318 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013296 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.013318 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013316 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.013318 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013322 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013332 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013336 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013341 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013345 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013349 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013352 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013358 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013364 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013368 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013372 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013376 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013380 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013385 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013389 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013393 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013397 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013401 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013405 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.013514 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013409 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013413 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013417 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013421 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013425 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013430 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013435 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013439 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013444 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013453 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013457 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013462 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013468 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013472 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013477 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013481 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013486 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013491 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013495 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.014370 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013499 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013504 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013508 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013512 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013516 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013520 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013525 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013530 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013534 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013538 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013542 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013547 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013552 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013556 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013561 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013565 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013569 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013574 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013578 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013582 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013587 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.015218 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013591 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013595 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013599 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013604 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013608 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013612 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013617 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013622 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013626 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013630 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013635 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013639 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013643 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013647 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013653 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013657 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013664 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013670 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013675 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.016137 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013679 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013684 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013690 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013695 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013699 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013704 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013708 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013712 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013738 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013744 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013748 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013752 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013756 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013760 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013767 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013773 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013777 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.013782 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014448 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.016802 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014459 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014464 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014470 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014475 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014480 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014484 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014489 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014493 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014498 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014502 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014506 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014510 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014515 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014519 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014523 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014529 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014534 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014538 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014542 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014547 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.017282 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014551 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014558 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014563 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014568 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014573 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014577 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014582 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014587 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014591 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014596 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014600 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014604 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014612 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014617 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014621 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014626 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014630 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014634 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014638 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.017898 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014643 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014648 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014652 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014656 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014660 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014664 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014668 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014672 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014676 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014682 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014686 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014690 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014694 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014698 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014703 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014707 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014711 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014715 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014739 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014743 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.018480 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014747 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014751 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014755 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014759 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014763 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014770 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014776 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014783 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014788 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014792 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014796 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014800 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014804 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014808 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014813 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014817 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014821 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014825 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014829 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014834 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.019180 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014838 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014842 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014847 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014852 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014855 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014860 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014864 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014868 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014874 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014878 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014882 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014887 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014891 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014895 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014899 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014907 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014913 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014919 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.014924 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015038 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:40:09.019669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015055 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015064 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015072 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015079 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015084 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015091 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015097 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015102 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015107 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015112 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015118 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015123 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015127 2572 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015132 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015137 2572 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015143 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015148 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015156 2572 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015161 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015166 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015171 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015176 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015182 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:40:09.020181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015187 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015191 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015197 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015201 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015207 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015211 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015219 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015223 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015229 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015234 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015238 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015243 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015248 2572 flags.go:64] FLAG: --enable-server="true" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015253 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015261 2572 flags.go:64] FLAG: --event-burst="100" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015265 2572 flags.go:64] FLAG: --event-qps="50" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015270 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015275 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015279 2572 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015285 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015290 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015295 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015300 2572 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015305 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015309 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:40:09.020789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015315 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015320 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015324 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015329 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015333 2572 flags.go:64] FLAG: --feature-gates="" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015340 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015345 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015351 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015356 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015360 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015366 2572 flags.go:64] FLAG: --help="false" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015370 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015376 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015384 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015388 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015394 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015399 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015404 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015409 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015413 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015418 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015422 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015427 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015432 2572 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:40:09.021417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015437 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015441 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015446 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015450 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015455 2572 flags.go:64] FLAG: --lock-file="" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015459 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015464 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015469 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015478 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015483 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015487 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015492 2572 flags.go:64] FLAG: --logging-format="text" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015496 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015502 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015506 2572 flags.go:64] FLAG: --manifest-url="" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015511 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015518 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015524 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015530 2572 flags.go:64] FLAG: --max-pods="110" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015534 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015540 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015547 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015552 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015557 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015562 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:40:09.022044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015567 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015578 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015582 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015588 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015592 2572 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015597 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015607 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015612 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015617 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015621 2572 flags.go:64] FLAG: --port="10250" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015626 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015631 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d84fce79e62afb9" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015636 2572 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015641 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015645 2572 flags.go:64] FLAG: --register-node="true" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015650 2572 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015656 2572 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015661 2572 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015666 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015670 2572 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015677 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015682 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015687 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015691 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015696 2572 flags.go:64] FLAG: --runonce="false" Jul 09 14:40:09.022641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015701 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015705 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015710 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015715 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015744 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015749 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015754 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015759 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015764 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015768 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015772 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015777 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015782 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015786 2572 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015791 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015800 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015804 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015809 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015816 2572 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015821 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015825 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015830 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015835 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015840 2572 flags.go:64] FLAG: --v="2" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015846 2572 flags.go:64] FLAG: --version="false" Jul 09 14:40:09.023281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015854 2572 flags.go:64] FLAG: --vmodule="" Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015862 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.015868 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016061 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016067 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016072 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016076 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016082 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016086 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016090 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016094 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016101 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016105 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016109 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016113 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016118 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016122 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016127 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016131 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016135 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.023944 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016139 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016142 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016147 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016150 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016154 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016158 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016162 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016166 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016173 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016178 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016184 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016189 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016194 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016201 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016208 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016214 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016219 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016224 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016228 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.024436 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016233 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016238 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016243 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016247 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016252 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016256 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016261 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016265 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016270 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016273 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016277 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016282 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016286 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016289 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016293 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016298 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016302 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016306 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016310 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.024922 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016314 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016318 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016322 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016326 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016330 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016335 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016339 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016347 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016354 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016358 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016362 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016366 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016370 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016374 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016378 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016383 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016387 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016392 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016396 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016400 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.025380 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016404 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016408 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016412 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016416 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016421 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016425 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016429 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016433 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016438 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016442 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016446 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016450 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016454 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016458 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016462 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016466 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016471 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016475 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016479 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016485 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.025891 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016489 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016495 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016499 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.016503 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.017301 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025157 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025174 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025196 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025202 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025262 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025267 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025270 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025273 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025276 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025278 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.026377 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025282 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025284 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025287 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025290 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025292 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025295 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025298 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025301 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025304 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025306 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025310 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025312 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025315 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025318 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025320 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025323 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025326 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025329 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025331 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025334 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.026782 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025337 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025340 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025342 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025347 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025350 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025352 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025355 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025357 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025360 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025362 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025365 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025367 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025370 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025372 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025375 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025377 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025380 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025383 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025385 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025388 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.027251 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025391 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025393 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025396 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025399 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025401 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025404 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025406 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025409 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025411 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025414 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025416 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025420 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025425 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025428 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025431 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025434 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025439 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025443 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025446 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.027734 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025449 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025451 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025453 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025456 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025458 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025461 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025463 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025466 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025468 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025471 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025474 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025476 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025478 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025481 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025484 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025487 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025489 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025491 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025494 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025496 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.028289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025499 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025503 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025506 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025509 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025512 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025514 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025517 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025520 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025523 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025525 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025528 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025531 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025534 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025537 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025542 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:40:09.028796 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025654 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025660 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025663 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025666 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025669 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025671 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025675 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025678 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025680 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025683 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025685 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025688 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025690 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025693 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025696 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025699 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025701 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025704 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025706 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025709 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:40:09.029169 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025711 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025714 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025735 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025738 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025741 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025744 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025746 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025749 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025753 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025756 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025759 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025761 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025764 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025766 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025769 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025771 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025774 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025776 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025779 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025781 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:40:09.029648 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025784 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025786 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025789 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025801 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025806 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025809 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025812 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025815 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025818 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025821 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025823 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025826 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025828 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025831 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025833 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025836 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025839 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025842 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025845 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:40:09.030158 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025847 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025850 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025853 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025855 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025858 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025860 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025863 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025865 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025868 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025870 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025873 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025875 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025877 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025880 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025882 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025885 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025887 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025890 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025892 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025895 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:40:09.030616 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025898 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025900 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025903 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025906 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025908 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025911 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025913 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025916 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025918 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025921 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025923 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025928 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025932 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025936 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025939 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025942 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025947 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025950 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025953 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:40:09.031138 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:09.025956 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.025961 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.026090 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.028274 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.030049 2572 server.go:1019] "Starting client certificate rotation" Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.030151 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:40:09.031598 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.030180 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:40:09.033162 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.033148 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:40:09.035525 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.035501 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:40:09.047450 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.047427 2572 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:40:09.049702 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.049686 2572 log.go:25] "Validated CRI v1 image API" Jul 09 14:40:09.051564 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.051546 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:40:09.054477 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.054454 2572 fs.go:135] Filesystem UUIDs: map[4b6ff12f-4b38-4db5-971c-ae831e26c118:/dev/nvme0n1p3 60cf7f09-38f5-4c73-844c-979e9f4846f7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 09 14:40:09.054552 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.054478 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:40:09.060670 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.060557 2572 manager.go:216] Machine: {Timestamp:2026-07-09 14:40:09.059146604 +0000 UTC m=+0.370557205 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100148 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28bcfccf4ed4899c169c92defc22eb SystemUUID:ec28bcfc-cf4e-d489-9c16-9c92defc22eb BootID:9dbbcbde-a0a4-493b-9421-8af0ad57d475 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:48:5e:76:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:48:5e:76:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:cd:c7:bb:09:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:40:09.060670 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.060664 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:40:09.060809 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.060773 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:40:09.062886 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.062869 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:40:09.063899 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.063867 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:40:09.064050 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.063903 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:40:09.064604 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.064594 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:40:09.064638 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.064606 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:40:09.064638 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.064618 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:40:09.065356 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.065346 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:40:09.066704 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.066693 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:40:09.070523 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070508 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:40:09.070642 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070633 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:40:09.070680 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070664 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:40:09.070680 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070676 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:40:09.070751 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070693 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:40:09.070751 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070703 2572 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:40:09.070751 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.070715 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:40:09.071126 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.071114 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:40:09.071175 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.071133 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:40:09.073517 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.073499 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:40:09.075944 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.075926 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:40:09.076025 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.075965 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:40:09.076167 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076154 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:40:09.076226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076175 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:40:09.076226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076184 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:40:09.076226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076194 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:40:09.076226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076206 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:40:09.076226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076215 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:40:09.076791 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076777 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:40:09.076844 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076794 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:40:09.076844 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076805 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:40:09.076844 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076814 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:40:09.076844 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076834 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:40:09.076975 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.076847 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:40:09.077555 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.077533 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:40:09.077589 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.077533 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:40:09.077846 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.077835 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:40:09.077894 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.077850 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:40:09.081040 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.081015 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:40:09.081239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.081225 2572 server.go:1268] "Started kubelet" Jul 09 14:40:09.081331 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.081301 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:40:09.081376 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.081317 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:40:09.081412 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.081400 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:40:09.082259 ip-10-0-140-95 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:40:09.084595 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.084519 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hbqg" Jul 09 14:40:09.084786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.084768 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:40:09.087119 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.087083 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:40:09.087669 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.087649 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:40:09.089114 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.088058 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-95.ec2.internal.18c0a608c7d394b7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-95.ec2.internal,UID:ip-10-0-140-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-95.ec2.internal,},FirstTimestamp:2026-07-09 14:40:09.081197751 +0000 UTC m=+0.392608390,LastTimestamp:2026-07-09 14:40:09.081197751 +0000 UTC m=+0.392608390,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-95.ec2.internal,}" Jul 09 14:40:09.089812 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.089785 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:40:09.089812 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.089804 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:40:09.089963 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.089906 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.090465 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090444 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:40:09.090557 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090448 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:40:09.090557 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090487 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:40:09.090652 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090561 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:40:09.090652 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090572 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090780 2572 factory.go:153] Registering CRI-O factory Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090796 2572 factory.go:223] Registration of the crio container factory successfully Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090850 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090861 2572 factory.go:55] Registering systemd factory Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090870 2572 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090890 2572 factory.go:103] Registering Raw factory Jul 09 14:40:09.090916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.090905 2572 manager.go:1196] Started watching for new ooms in manager Jul 09 14:40:09.091294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.091279 2572 manager.go:349] Starting recovery of all containers Jul 09 14:40:09.093949 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.093823 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7hbqg" Jul 09 14:40:09.098069 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.098021 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:40:09.098169 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.098063 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:40:09.103519 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.103502 2572 manager.go:354] Recovery completed Jul 09 14:40:09.108048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.108033 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.110593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.110573 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.110668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.110611 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.110668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.110625 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.111298 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.111281 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:40:09.111298 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.111298 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:40:09.111423 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.111318 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:40:09.111423 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.111309 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.112439 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112425 2572 policy_none.go:49] "None policy: Start" Jul 09 14:40:09.112513 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112442 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:40:09.112513 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112452 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:40:09.112513 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112480 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.112513 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112507 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.112687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.112521 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.113454 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.113441 2572 policy_none.go:47] "Start" Jul 09 14:40:09.154382 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154360 2572 manager.go:337] "Starting Device Plugin manager" Jul 09 14:40:09.154480 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.154409 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:40:09.154480 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154419 2572 server.go:87] "Starting device plugin registration server" Jul 09 14:40:09.154707 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154694 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:40:09.154758 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154709 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:40:09.154869 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154843 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:40:09.154988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154944 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:40:09.154988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.154959 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:40:09.155473 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.155454 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:40:09.155546 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.155509 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.255255 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.255196 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.256302 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.256283 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.256392 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.256318 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.256392 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.256329 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.256392 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.256363 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.267896 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.267870 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.268016 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.267904 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-95.ec2.internal\": node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.279596 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.279568 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.292320 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.292294 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:40:09.293787 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.293761 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:40:09.293908 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.293827 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:40:09.293908 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.293857 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:40:09.293908 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.293900 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:40:09.296073 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.296051 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:09.380488 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.380422 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.394885 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.394858 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal"] Jul 09 14:40:09.394972 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.394932 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.396101 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.396085 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.396171 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.396123 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.396209 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.396180 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.397476 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.397462 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.397623 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.397601 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.397668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.397641 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.398296 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398275 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.398402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398276 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.398402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398311 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.398402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398328 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.398402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398336 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.398402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.398352 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.399539 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.399522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.399596 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.399550 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:40:09.401084 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.401064 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:40:09.401167 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.401099 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:40:09.401167 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.401113 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:40:09.418486 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.418461 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-95.ec2.internal\" not found" node="ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.423409 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.423392 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-95.ec2.internal\" not found" node="ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.481329 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.481303 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.491608 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.491579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.491760 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.491611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.491760 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.491635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fb4eca1d55ac7e08dfc34b0b4593437-config\") pod \"kube-apiserver-proxy-ip-10-0-140-95.ec2.internal\" (UID: \"1fb4eca1d55ac7e08dfc34b0b4593437\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.581985 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.581898 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.591941 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.591917 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.592022 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.592009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.592083 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.592022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.592083 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.592076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fb4eca1d55ac7e08dfc34b0b4593437-config\") pod \"kube-apiserver-proxy-ip-10-0-140-95.ec2.internal\" (UID: \"1fb4eca1d55ac7e08dfc34b0b4593437\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.592247 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.592032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f9fa9ede41c3757ac893598bf81212cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal\" (UID: \"f9fa9ede41c3757ac893598bf81212cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.592247 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.592131 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1fb4eca1d55ac7e08dfc34b0b4593437-config\") pod \"kube-apiserver-proxy-ip-10-0-140-95.ec2.internal\" (UID: \"1fb4eca1d55ac7e08dfc34b0b4593437\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.689575 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.689537 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.722319 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.722283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.726574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:09.726416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:09.790257 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.790203 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.892760 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.892642 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:09.997071 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:09.997033 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.030820 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.030782 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:40:10.031494 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.030966 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:40:10.097311 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.097265 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:35:09 +0000 UTC" deadline="2028-04-16 12:28:30.854557276 +0000 UTC" Jul 09 14:40:10.097311 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.097298 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.097471 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.097301 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15525h48m20.757260064s" Jul 09 14:40:10.101418 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.101397 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:10.197822 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.197697 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.297933 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.297899 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.314690 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.314663 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:10.398928 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.398890 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.494155 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:10.494115 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb4eca1d55ac7e08dfc34b0b4593437.slice/crio-f59fc5070e7e66f3cb26cb3246918b38434d2473d0ceed9ea718c2938f82c27e WatchSource:0}: Error finding container f59fc5070e7e66f3cb26cb3246918b38434d2473d0ceed9ea718c2938f82c27e: Status 404 returned error can't find the container with id f59fc5070e7e66f3cb26cb3246918b38434d2473d0ceed9ea718c2938f82c27e Jul 09 14:40:10.494431 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:10.494397 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fa9ede41c3757ac893598bf81212cf.slice/crio-0d07121eb4eee43ea27e4e5dfd7f34b779dc06130a5c5cc1c355e901fb69c584 WatchSource:0}: Error finding container 0d07121eb4eee43ea27e4e5dfd7f34b779dc06130a5c5cc1c355e901fb69c584: Status 404 returned error can't find the container with id 0d07121eb4eee43ea27e4e5dfd7f34b779dc06130a5c5cc1c355e901fb69c584 Jul 09 14:40:10.499462 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.499435 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.502280 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.502259 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:40:10.600452 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:10.600398 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-95.ec2.internal\" not found" Jul 09 14:40:10.642868 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.642834 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:10.693093 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.693042 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" Jul 09 14:40:10.705252 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.705222 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:40:10.706362 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.706345 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" Jul 09 14:40:10.716231 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:10.716210 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:40:11.073787 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.073722 2572 apiserver.go:52] "Watching apiserver" Jul 09 14:40:11.081856 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.081828 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:40:11.083688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.083192 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-s5bsh","openshift-multus/network-metrics-daemon-2wzc2","openshift-network-operator/iptables-alerter-lth88","kube-system/global-pull-secret-syncer-pxvxg","kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal","openshift-image-registry/node-ca-bpmkm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal","openshift-multus/multus-additional-cni-plugins-7mtbz","openshift-multus/multus-j7n8g","openshift-network-diagnostics/network-check-target-mqtsz","openshift-ovn-kubernetes/ovnkube-node-5nfzq","kube-system/konnectivity-agent-59d2z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj","openshift-cluster-node-tuning-operator/tuned-2g5rd"] Jul 09 14:40:11.085216 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.085187 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:11.085349 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.085295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:11.086923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.086902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.088520 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.088495 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.090101 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090075 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:40:11.090268 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090248 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.090386 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090365 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:40:11.090432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090408 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:40:11.090564 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090549 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.090634 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090577 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.090634 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090617 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6h7mm\"" Jul 09 14:40:11.090703 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.090642 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:11.090809 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090778 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:40:11.090877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.090832 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:40:11.091381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.091304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.091381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.091318 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4h5c\"" Jul 09 14:40:11.091981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.091600 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.091981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.091660 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.091981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.091700 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:40:11.093030 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.093012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.094837 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.094817 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.095190 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.095176 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.095492 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.095479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.096396 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.096374 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9dqsr\"" Jul 09 14:40:11.096578 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.096564 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pnmf4\"" Jul 09 14:40:11.096696 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.096653 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.096828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.096811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:40:11.097172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.097034 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.097530 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.097510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.098357 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.098334 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.098447 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.098395 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:11.098820 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.098773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:40:11.098909 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.098787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.098966 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.098927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.099114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.099096 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.099186 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.099121 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:40:11.099600 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.099414 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-92dm4\"" Jul 09 14:40:11.100169 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.100149 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.100497 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.100476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.101453 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.101436 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:40:11.101629 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.101616 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.101889 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.101872 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zbz4v\"" Jul 09 14:40:11.102025 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102003 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:40:11.102133 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102006 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d8hhh\"" Jul 09 14:40:11.102186 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.102532 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102285 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:40:11.102983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-node-log\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.102995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-modprobe-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-host\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-kubelet\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103114 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-bin\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103140 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-host-slash\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gr2s\" (UniqueName: \"kubernetes.io/projected/e030ab04-2242-40d0-b77b-12f4a6119f74-kube-api-access-8gr2s\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-var-lib-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-script-lib\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103325 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-iptables-alerter-script\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k96bj\" (UniqueName: \"kubernetes.io/projected/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-kube-api-access-k96bj\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysconfig\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-kubernetes\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-systemd\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-sys\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103530 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-conf\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.103593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-run\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-lib-modules\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-tmp\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-netns\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-systemd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103728 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-ovn\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-netd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-var-lib-kubelet\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f3a0e7-970d-470d-af83-f72080a42e6a-ovn-node-metrics-cert\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-kubelet-config\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-tuned\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-systemd-units\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.103986 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-slash\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-etc-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-env-overrides\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbbd\" (UniqueName: \"kubernetes.io/projected/59f3a0e7-970d-470d-af83-f72080a42e6a-kube-api-access-mhbbd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-log-socket\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-config\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-dbus\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104561 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104614 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wcdb9\"" Jul 09 14:40:11.104992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.104972 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:40:11.105282 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.105130 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqv4r\"" Jul 09 14:40:11.105665 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.105645 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:40:11.105814 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.105794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:40:11.108089 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.108065 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:40:11.111273 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.111255 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:40:11.129228 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.129197 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7nfw" Jul 09 14:40:11.138589 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.138559 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7nfw" Jul 09 14:40:11.192264 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.192233 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:40:11.205578 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-kubernetes\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205743 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-lib-modules\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205743 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205618 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-k8s-cni-cncf-io\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.205743 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205705 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-kubernetes\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205774 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-lib-modules\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-run\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-tmp\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-netns\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.205945 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.205913 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-run\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.206002 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:11.705976521 +0000 UTC m=+3.017387133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.205918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45lb\" (UniqueName: \"kubernetes.io/projected/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-kube-api-access-b45lb\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-netns\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-systemd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-ovn\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206101 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206145 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-ovn\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-kubelet-config\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-tuned\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206252 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-kubelet-config\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-hostroot\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-multus-certs\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.206377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206377 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-netns\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15512653-13ed-4961-99d1-e3babbf24bf7-hosts-file\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-systemd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec6c0aff-a0ba-4536-ad3b-0363debd5403-agent-certs\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-systemd-units\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-slash\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbbd\" (UniqueName: \"kubernetes.io/projected/59f3a0e7-970d-470d-af83-f72080a42e6a-kube-api-access-mhbbd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206537 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-systemd-units\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-slash\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-kubelet\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-log-socket\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-config\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-dbus\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4x4r\" (UniqueName: \"kubernetes.io/projected/6052396f-0d1f-4c75-a63b-2c7b4592e724-kube-api-access-f4x4r\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-multus\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.207196 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206794 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15512653-13ed-4961-99d1-e3babbf24bf7-tmp-dir\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-node-log\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-modprobe-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6052396f-0d1f-4c75-a63b-2c7b4592e724-serviceca\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206883 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-dbus\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-socket-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206751 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-log-socket\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-os-release\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.206975 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-bin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-kubelet\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-node-log\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-kubelet\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207097 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-modprobe-d\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-bin\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207140 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-host-slash\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-sys-fs\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207177 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-bin\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-daemon-config\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-host-slash\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6052396f-0d1f-4c75-a63b-2c7b4592e724-host\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207292 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-config\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-var-lib-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k96bj\" (UniqueName: \"kubernetes.io/projected/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-kube-api-access-k96bj\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-systemd\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-sys\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-systemd\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207448 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207474 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-system-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207479 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-sys\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207388 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-var-lib-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-system-cni-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-conf\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.208929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cni-binary-copy\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207676 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r2j4\" (UniqueName: \"kubernetes.io/projected/2ccf631e-01f6-4635-8f46-5a410f14643c-kube-api-access-9r2j4\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207701 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec6c0aff-a0ba-4536-ad3b-0363debd5403-konnectivity-ca\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-netd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207767 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-var-lib-kubelet\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-os-release\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77287\" (UniqueName: \"kubernetes.io/projected/15512653-13ed-4961-99d1-e3babbf24bf7-kube-api-access-77287\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f3a0e7-970d-470d-af83-f72080a42e6a-ovn-node-metrics-cert\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ddh9\" (UniqueName: \"kubernetes.io/projected/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kube-api-access-9ddh9\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207934 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysctl-conf\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.207953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-socket-dir-parent\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-etc-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-cni-netd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208074 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-var-lib-kubelet\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-env-overrides\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.209619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-device-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfgdx\" (UniqueName: \"kubernetes.io/projected/48144e0e-3d98-4296-8337-91320890268f-kube-api-access-rfgdx\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208253 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cnibin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-etc-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-host\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-conf-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gr2s\" (UniqueName: \"kubernetes.io/projected/e030ab04-2242-40d0-b77b-12f4a6119f74-kube-api-access-8gr2s\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208503 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-etc-kubernetes\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-env-overrides\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-registration-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-cnibin\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-script-lib\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.210420 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-iptables-alerter-script\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysconfig\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208849 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-run-openvswitch\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208886 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208903 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59f3a0e7-970d-470d-af83-f72080a42e6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.208950 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-host\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.209030 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-sysconfig\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.209422 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59f3a0e7-970d-470d-af83-f72080a42e6a-ovnkube-script-lib\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.209524 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-iptables-alerter-script\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.209627 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-tmp\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.209685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e030ab04-2242-40d0-b77b-12f4a6119f74-etc-tuned\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.211041 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.210918 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59f3a0e7-970d-470d-af83-f72080a42e6a-ovn-node-metrics-cert\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.217764 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.217689 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:11.217764 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.217717 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:11.217947 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.217782 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:11.217947 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.217916 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:11.717885452 +0000 UTC m=+3.029296067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:11.218790 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.218763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k96bj\" (UniqueName: \"kubernetes.io/projected/5cf16a16-6879-4f60-95c6-2a5f620eb8e5-kube-api-access-k96bj\") pod \"iptables-alerter-lth88\" (UID: \"5cf16a16-6879-4f60-95c6-2a5f620eb8e5\") " pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.220613 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.220586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbbd\" (UniqueName: \"kubernetes.io/projected/59f3a0e7-970d-470d-af83-f72080a42e6a-kube-api-access-mhbbd\") pod \"ovnkube-node-5nfzq\" (UID: \"59f3a0e7-970d-470d-af83-f72080a42e6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.223024 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.222977 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gr2s\" (UniqueName: \"kubernetes.io/projected/e030ab04-2242-40d0-b77b-12f4a6119f74-kube-api-access-8gr2s\") pod \"tuned-2g5rd\" (UID: \"e030ab04-2242-40d0-b77b-12f4a6119f74\") " pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.307404 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.307345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" event={"ID":"f9fa9ede41c3757ac893598bf81212cf","Type":"ContainerStarted","Data":"0d07121eb4eee43ea27e4e5dfd7f34b779dc06130a5c5cc1c355e901fb69c584"} Jul 09 14:40:11.309126 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309068 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" event={"ID":"1fb4eca1d55ac7e08dfc34b0b4593437","Type":"ContainerStarted","Data":"f59fc5070e7e66f3cb26cb3246918b38434d2473d0ceed9ea718c2938f82c27e"} Jul 09 14:40:11.309315 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309287 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-netns\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309376 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45lb\" (UniqueName: \"kubernetes.io/projected/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-kube-api-access-b45lb\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309376 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-hostroot\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-multus-certs\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309399 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15512653-13ed-4961-99d1-e3babbf24bf7-hosts-file\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.309468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-netns\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec6c0aff-a0ba-4536-ad3b-0363debd5403-agent-certs\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.309468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-kubelet\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4x4r\" (UniqueName: \"kubernetes.io/projected/6052396f-0d1f-4c75-a63b-2c7b4592e724-kube-api-access-f4x4r\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-multus\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15512653-13ed-4961-99d1-e3babbf24bf7-tmp-dir\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6052396f-0d1f-4c75-a63b-2c7b4592e724-serviceca\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-socket-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309607 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-os-release\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-bin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.309657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-sys-fs\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-daemon-config\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6052396f-0d1f-4c75-a63b-2c7b4592e724-host\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.309723 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309811 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.309839 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:11.809823656 +0000 UTC m=+3.121234246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-system-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-multus\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-system-cni-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-sys-fs\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.309922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-kubelet\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.310141 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310127 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-multus-certs\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310169 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-hostroot\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6052396f-0d1f-4c75-a63b-2c7b4592e724-host\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310539 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-daemon-config\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310607 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-system-cni-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310648 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-system-cni-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310782 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15512653-13ed-4961-99d1-e3babbf24bf7-tmp-dir\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cni-binary-copy\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r2j4\" (UniqueName: \"kubernetes.io/projected/2ccf631e-01f6-4635-8f46-5a410f14643c-kube-api-access-9r2j4\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310898 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-socket-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec6c0aff-a0ba-4536-ad3b-0363debd5403-konnectivity-ca\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-os-release\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310968 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-os-release\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311012 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-var-lib-cni-bin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311013 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6052396f-0d1f-4c75-a63b-2c7b4592e724-serviceca\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311100 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-os-release\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.310990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77287\" (UniqueName: \"kubernetes.io/projected/15512653-13ed-4961-99d1-e3babbf24bf7-kube-api-access-77287\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311313 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ddh9\" (UniqueName: \"kubernetes.io/projected/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kube-api-access-9ddh9\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-socket-dir-parent\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-device-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfgdx\" (UniqueName: \"kubernetes.io/projected/48144e0e-3d98-4296-8337-91320890268f-kube-api-access-rfgdx\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cnibin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-conf-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311491 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-etc-kubernetes\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311561 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15512653-13ed-4961-99d1-e3babbf24bf7-hosts-file\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311579 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-registration-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311584 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cni-binary-copy\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-cnibin\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.311877 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311616 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311648 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec6c0aff-a0ba-4536-ad3b-0363debd5403-konnectivity-ca\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311661 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-etc-kubernetes\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48144e0e-3d98-4296-8337-91320890268f-cnibin\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311717 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-registration-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-cnibin\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-conf-dir\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-device-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-k8s-cni-cncf-io\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311913 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-host-run-k8s-cni-cncf-io\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311862 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-multus-socket-dir-parent\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48144e0e-3d98-4296-8337-91320890268f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.312786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.311980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.316811 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.316741 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec6c0aff-a0ba-4536-ad3b-0363debd5403-agent-certs\") pod \"konnectivity-agent-59d2z\" (UID: \"ec6c0aff-a0ba-4536-ad3b-0363debd5403\") " pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.327048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.327022 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfgdx\" (UniqueName: \"kubernetes.io/projected/48144e0e-3d98-4296-8337-91320890268f-kube-api-access-rfgdx\") pod \"multus-additional-cni-plugins-7mtbz\" (UID: \"48144e0e-3d98-4296-8337-91320890268f\") " pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.327542 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.327515 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4x4r\" (UniqueName: \"kubernetes.io/projected/6052396f-0d1f-4c75-a63b-2c7b4592e724-kube-api-access-f4x4r\") pod \"node-ca-bpmkm\" (UID: \"6052396f-0d1f-4c75-a63b-2c7b4592e724\") " pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.328058 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.328033 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ddh9\" (UniqueName: \"kubernetes.io/projected/d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05-kube-api-access-9ddh9\") pod \"aws-ebs-csi-driver-node-m9gdj\" (UID: \"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.328365 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.328340 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77287\" (UniqueName: \"kubernetes.io/projected/15512653-13ed-4961-99d1-e3babbf24bf7-kube-api-access-77287\") pod \"node-resolver-s5bsh\" (UID: \"15512653-13ed-4961-99d1-e3babbf24bf7\") " pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.329226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.329115 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45lb\" (UniqueName: \"kubernetes.io/projected/6e8dd422-06e4-4d5c-922a-ee08c3aadfc9-kube-api-access-b45lb\") pod \"multus-j7n8g\" (UID: \"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9\") " pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.329590 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.329570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r2j4\" (UniqueName: \"kubernetes.io/projected/2ccf631e-01f6-4635-8f46-5a410f14643c-kube-api-access-9r2j4\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.402574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.402255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:11.412264 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.412036 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lth88" Jul 09 14:40:11.415004 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.414974 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f3a0e7_970d_470d_af83_f72080a42e6a.slice/crio-31d7cf00ddd33e72debb213528d23e06c52c18e8d92a865e8613e6180fcfda4a WatchSource:0}: Error finding container 31d7cf00ddd33e72debb213528d23e06c52c18e8d92a865e8613e6180fcfda4a: Status 404 returned error can't find the container with id 31d7cf00ddd33e72debb213528d23e06c52c18e8d92a865e8613e6180fcfda4a Jul 09 14:40:11.421604 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.421571 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" Jul 09 14:40:11.427868 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.427811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bpmkm" Jul 09 14:40:11.430006 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.429979 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf16a16_6879_4f60_95c6_2a5f620eb8e5.slice/crio-4868d81ebf263ac707ef14a12f8a98cd252718f4028c956aa77f3a4814dccbaf WatchSource:0}: Error finding container 4868d81ebf263ac707ef14a12f8a98cd252718f4028c956aa77f3a4814dccbaf: Status 404 returned error can't find the container with id 4868d81ebf263ac707ef14a12f8a98cd252718f4028c956aa77f3a4814dccbaf Jul 09 14:40:11.436068 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.435888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7n8g" Jul 09 14:40:11.437363 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.437274 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode030ab04_2242_40d0_b77b_12f4a6119f74.slice/crio-4cbc9c8888f7dd0d40584ea52ec91a4be08631964716446ccca72b1c1b61839d WatchSource:0}: Error finding container 4cbc9c8888f7dd0d40584ea52ec91a4be08631964716446ccca72b1c1b61839d: Status 404 returned error can't find the container with id 4cbc9c8888f7dd0d40584ea52ec91a4be08631964716446ccca72b1c1b61839d Jul 09 14:40:11.443542 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.443385 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" Jul 09 14:40:11.450913 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.450894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5bsh" Jul 09 14:40:11.457193 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.456948 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8dd422_06e4_4d5c_922a_ee08c3aadfc9.slice/crio-209f336e818053eab4f1035eb6fb6346cad3862063cc727f7a9995acd47c598c WatchSource:0}: Error finding container 209f336e818053eab4f1035eb6fb6346cad3862063cc727f7a9995acd47c598c: Status 404 returned error can't find the container with id 209f336e818053eab4f1035eb6fb6346cad3862063cc727f7a9995acd47c598c Jul 09 14:40:11.457314 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.457274 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" Jul 09 14:40:11.464940 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.464918 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:11.467631 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.467584 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15512653_13ed_4961_99d1_e3babbf24bf7.slice/crio-802ad068223a83cd379be79da81ccef5362ce1d83814e3047e8f30f041ec1e34 WatchSource:0}: Error finding container 802ad068223a83cd379be79da81ccef5362ce1d83814e3047e8f30f041ec1e34: Status 404 returned error can't find the container with id 802ad068223a83cd379be79da81ccef5362ce1d83814e3047e8f30f041ec1e34 Jul 09 14:40:11.477628 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:11.477442 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6c0aff_a0ba_4536_ad3b_0363debd5403.slice/crio-bf40f6a761647b6e324e5ecd52797b32b8a182227832e9866d02941e87cf8d33 WatchSource:0}: Error finding container bf40f6a761647b6e324e5ecd52797b32b8a182227832e9866d02941e87cf8d33: Status 404 returned error can't find the container with id bf40f6a761647b6e324e5ecd52797b32b8a182227832e9866d02941e87cf8d33 Jul 09 14:40:11.714132 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.714002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:11.714306 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.714191 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:11.714306 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.714268 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:12.714247415 +0000 UTC m=+4.025658006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:11.815062 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.815022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:11.815255 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:11.815080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:11.815255 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815202 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:11.815255 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815222 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:11.815255 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815240 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:11.815255 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815254 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:11.815534 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815279 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:12.815259383 +0000 UTC m=+4.126669996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:11.815534 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:11.815305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:12.815288181 +0000 UTC m=+4.126698792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:12.141968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.141806 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:35:11 +0000 UTC" deadline="2028-01-05 02:01:10.016927954 +0000 UTC" Jul 09 14:40:12.141968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.141859 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13067h20m57.87507475s" Jul 09 14:40:12.312778 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.312655 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-59d2z" event={"ID":"ec6c0aff-a0ba-4536-ad3b-0363debd5403","Type":"ContainerStarted","Data":"bf40f6a761647b6e324e5ecd52797b32b8a182227832e9866d02941e87cf8d33"} Jul 09 14:40:12.314669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.314458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5bsh" event={"ID":"15512653-13ed-4961-99d1-e3babbf24bf7","Type":"ContainerStarted","Data":"802ad068223a83cd379be79da81ccef5362ce1d83814e3047e8f30f041ec1e34"} Jul 09 14:40:12.316605 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.316556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7n8g" event={"ID":"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9","Type":"ContainerStarted","Data":"209f336e818053eab4f1035eb6fb6346cad3862063cc727f7a9995acd47c598c"} Jul 09 14:40:12.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.318045 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpmkm" event={"ID":"6052396f-0d1f-4c75-a63b-2c7b4592e724","Type":"ContainerStarted","Data":"64b8a26b5fcd1e3216ae4c183e28f7dbc695227e7663a42f83f0a916c01e0805"} Jul 09 14:40:12.320395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.320368 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" event={"ID":"e030ab04-2242-40d0-b77b-12f4a6119f74","Type":"ContainerStarted","Data":"4cbc9c8888f7dd0d40584ea52ec91a4be08631964716446ccca72b1c1b61839d"} Jul 09 14:40:12.322435 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.322377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerStarted","Data":"d7740318c8bff22bb45f3c5e316c90bc19c50d592b53cfcaba4465cfdd3aa605"} Jul 09 14:40:12.324153 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.324128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" event={"ID":"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05","Type":"ContainerStarted","Data":"175ab33f91fe697aec7afe48ae8080ae69d86576803bd346a93be69dd394c55b"} Jul 09 14:40:12.325517 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.325477 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lth88" event={"ID":"5cf16a16-6879-4f60-95c6-2a5f620eb8e5","Type":"ContainerStarted","Data":"4868d81ebf263ac707ef14a12f8a98cd252718f4028c956aa77f3a4814dccbaf"} Jul 09 14:40:12.327147 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.327120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"31d7cf00ddd33e72debb213528d23e06c52c18e8d92a865e8613e6180fcfda4a"} Jul 09 14:40:12.725032 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.724964 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:12.725213 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.725106 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:12.725213 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.725168 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:14.725149644 +0000 UTC m=+6.036560247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:12.826023 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.825987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:12.826197 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:12.826056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:12.826266 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826256 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:12.826318 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826275 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:12.826318 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826289 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:12.826426 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826349 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:14.826329727 +0000 UTC m=+6.137740339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:12.826489 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826430 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:12.826489 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:12.826484 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:14.826465806 +0000 UTC m=+6.137876396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:13.142112 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:13.142025 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:35:11 +0000 UTC" deadline="2028-01-11 19:53:56.21203353 +0000 UTC" Jul 09 14:40:13.142112 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:13.142068 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13229h13m43.069969431s" Jul 09 14:40:13.296693 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:13.296662 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:13.296871 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:13.296830 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:13.297256 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:13.297238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:13.297370 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:13.297349 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:13.297432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:13.297412 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:13.297509 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:13.297491 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:14.744188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:14.744148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:14.744655 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.744345 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:14.744655 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.744483 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:18.74445305 +0000 UTC m=+10.055863654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:14.845632 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:14.845593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:14.845854 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:14.845661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:14.845854 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.845845 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:14.845976 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.845869 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:14.845976 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.845883 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:14.845976 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.845950 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:18.845930143 +0000 UTC m=+10.157340734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:14.846422 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.846334 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:14.846422 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:14.846388 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:18.84637275 +0000 UTC m=+10.157783342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:15.295884 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:15.295851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:15.296068 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:15.295986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:15.296423 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:15.296397 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:15.296524 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:15.296486 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:15.298222 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:15.298189 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:15.298326 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:15.298288 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:17.296879 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:17.296844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:17.297340 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:17.296985 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:17.297340 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:17.297200 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:17.297340 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:17.297303 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:17.297492 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:17.297380 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:17.297492 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:17.297296 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:18.779455 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:18.779414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:18.779881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.779631 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:18.779881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.779694 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:26.779676145 +0000 UTC m=+18.091086735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:18.880759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:18.880702 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:18.880943 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:18.880784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:18.881003 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.880939 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:18.881003 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.880975 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:18.881003 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.880996 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:18.881168 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.881007 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:26.880992455 +0000 UTC m=+18.192403045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:18.881168 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.881015 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:18.881168 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:18.881067 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:26.881048873 +0000 UTC m=+18.192459466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:19.295988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:19.295953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:19.296127 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:19.295953 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:19.296127 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:19.296086 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:19.296227 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:19.295971 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:19.296227 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:19.296190 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:19.296285 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:19.296229 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:21.294565 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:21.294316 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:21.294565 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:21.294351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:21.294565 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:21.294320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:21.294565 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:21.294435 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:21.294565 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:21.294565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:21.295170 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:21.294630 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:23.295048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:23.295014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:23.295518 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:23.295014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:23.295518 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:23.295409 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:23.295629 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:23.295544 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:23.295629 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:23.295025 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:23.295763 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:23.295742 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:25.294733 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:25.294667 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:25.294733 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:25.294715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:25.295198 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:25.294671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:25.295198 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:25.294825 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:25.295198 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:25.294928 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:25.295198 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:25.295012 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:26.846105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:26.846070 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:26.846647 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.846229 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:26.846647 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.846304 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:42.846283931 +0000 UTC m=+34.157694521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:26.947421 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:26.947386 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:26.947421 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:26.947428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947545 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947560 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947577 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947589 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947616 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:40:42.947597456 +0000 UTC m=+34.259008056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:26.947659 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:26.947635 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:40:42.947624554 +0000 UTC m=+34.259035154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:27.294523 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:27.294437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:27.294688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:27.294446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:27.294688 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:27.294587 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:27.294688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:27.294446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:27.294688 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:27.294658 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:27.294907 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:27.294755 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:29.295483 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:29.295449 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:29.295974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:29.295540 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:29.295974 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:29.295560 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:29.295974 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:29.295649 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:29.295974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:29.295708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:29.295974 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:29.295793 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:31.295106 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.294816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:31.295771 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.294834 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:31.295771 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:31.295206 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:31.295771 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.294902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:31.295771 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:31.295277 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:31.295771 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:31.295333 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:31.362678 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.362647 2572 generic.go:356] "Generic (PLEG): container finished" podID="f9fa9ede41c3757ac893598bf81212cf" containerID="fcc1f48930ab87d85a34487eb598592ec7b0e52317f7849ba3a72906d83ede45" exitCode=0 Jul 09 14:40:31.362849 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.362757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" event={"ID":"f9fa9ede41c3757ac893598bf81212cf","Type":"ContainerDied","Data":"fcc1f48930ab87d85a34487eb598592ec7b0e52317f7849ba3a72906d83ede45"} Jul 09 14:40:31.364108 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.364086 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" event={"ID":"1fb4eca1d55ac7e08dfc34b0b4593437","Type":"ContainerStarted","Data":"48ccbbb057e48fb108a3799c96e046616ba04f49a99a978a3dce40e563d21bee"} Jul 09 14:40:31.365461 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.365442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-59d2z" event={"ID":"ec6c0aff-a0ba-4536-ad3b-0363debd5403","Type":"ContainerStarted","Data":"fd459db246889090e1a818b2a4d9b6aa25b42c096ac2325c8f71b20a83a02d2c"} Jul 09 14:40:31.366777 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.366757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5bsh" event={"ID":"15512653-13ed-4961-99d1-e3babbf24bf7","Type":"ContainerStarted","Data":"a48a7e675538c9976a565f6c0c426140603a16d0b6d8f7c18a128ef1a6d872a9"} Jul 09 14:40:31.368036 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.368007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7n8g" event={"ID":"6e8dd422-06e4-4d5c-922a-ee08c3aadfc9","Type":"ContainerStarted","Data":"e35dee57fa8c10b24b4457bd6976d9032a1f407fd33df3805b2637640b6e579c"} Jul 09 14:40:31.369458 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.369427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bpmkm" event={"ID":"6052396f-0d1f-4c75-a63b-2c7b4592e724","Type":"ContainerStarted","Data":"b5eb83f7fddd0bbca1860c127235a99e2c52e1dbc15c97c4e81c6bd206208f9e"} Jul 09 14:40:31.370843 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.370824 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" event={"ID":"e030ab04-2242-40d0-b77b-12f4a6119f74","Type":"ContainerStarted","Data":"a401aac1983e24f420e77a7b8e68c7f546bc9c04650c9324a68fc0cfc009bb8c"} Jul 09 14:40:31.372213 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.372191 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="d0d1e1334ae539566f2b2546b19c1403cc20420f1aba88fbca66b43f8b63c51f" exitCode=0 Jul 09 14:40:31.372306 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.372222 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"d0d1e1334ae539566f2b2546b19c1403cc20420f1aba88fbca66b43f8b63c51f"} Jul 09 14:40:31.373652 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.373634 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" event={"ID":"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05","Type":"ContainerStarted","Data":"9993955edb2bb1e11828d045e0575fc5f84f7b021da77f1f200e4550eddd7e79"} Jul 09 14:40:31.375671 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.375654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"7d3ca8dea61655503cf5121528151683977c6649000657d3fac127f6380a026e"} Jul 09 14:40:31.375767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.375705 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"db715ab5d69715c7fb84bc7dc4944c2008c24a41370202a18f24a87f252badc6"} Jul 09 14:40:31.375767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.375758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"df86a53b40e2ae863de0b8ba9b8d8304d2fcba40052de7582841530a755e998a"} Jul 09 14:40:31.398166 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.398121 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j7n8g" podStartSLOduration=2.950218398 podStartE2EDuration="22.398104341s" totalImagesPullingTime="19.447885943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.397554818 +0000 UTC m=+22.708965431" watchObservedRunningTime="2026-07-09 14:40:31.398104341 +0000 UTC m=+22.709515016" Jul 09 14:40:31.440287 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.440244 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bpmkm" podStartSLOduration=7.947149795 podStartE2EDuration="22.440229851s" totalImagesPullingTime="14.493080056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.440018171 +0000 UTC m=+22.751428782" watchObservedRunningTime="2026-07-09 14:40:31.440229851 +0000 UTC m=+22.751640462" Jul 09 14:40:31.456421 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.456379 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s5bsh" podStartSLOduration=3.104861708 podStartE2EDuration="22.4563648s" totalImagesPullingTime="19.351503092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.456165906 +0000 UTC m=+22.767576521" watchObservedRunningTime="2026-07-09 14:40:31.4563648 +0000 UTC m=+22.767775411" Jul 09 14:40:31.473625 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.473577 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-59d2z" podStartSLOduration=3.132821178 podStartE2EDuration="22.473560198s" totalImagesPullingTime="19.34073902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.472986288 +0000 UTC m=+22.784396900" watchObservedRunningTime="2026-07-09 14:40:31.473560198 +0000 UTC m=+22.784970809" Jul 09 14:40:31.488151 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.488107 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-95.ec2.internal" podStartSLOduration=21.488093598 podStartE2EDuration="21.488093598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.487935524 +0000 UTC m=+22.799346146" watchObservedRunningTime="2026-07-09 14:40:31.488093598 +0000 UTC m=+22.799504208" Jul 09 14:40:31.505689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:31.505640 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2g5rd" podStartSLOduration=3.121826965 podStartE2EDuration="22.505625888s" totalImagesPullingTime="19.383798923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:31.50525756 +0000 UTC m=+22.816668190" watchObservedRunningTime="2026-07-09 14:40:31.505625888 +0000 UTC m=+22.817036496" Jul 09 14:40:32.380503 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.380412 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" event={"ID":"f9fa9ede41c3757ac893598bf81212cf","Type":"ContainerStarted","Data":"31f49fc020331d796c13f928c4b704aa6e2153a7972eaed9787805ff7751f161"} Jul 09 14:40:32.382052 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.382024 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lth88" event={"ID":"5cf16a16-6879-4f60-95c6-2a5f620eb8e5","Type":"ContainerStarted","Data":"e15ea0d4979193ce6f8c0b98ed5e5537ae0b899258d58184f04bef8467236879"} Jul 09 14:40:32.385358 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.385334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"39b15ec52f007635c2d3c0b73fb55cf1a78a60f60207565957737636329f35ff"} Jul 09 14:40:32.385473 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.385392 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"3f1a9c90b01fec860e8d390f12cfe5841cb1e301308bb6962a200c75d9a4ceba"} Jul 09 14:40:32.385473 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.385433 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"f2291186ecfcd6b44775e6a801fd39da16297c278c6f5dbf5f0922ee32b90880"} Jul 09 14:40:32.413983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:32.413932 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-95.ec2.internal" podStartSLOduration=22.4139085 podStartE2EDuration="22.4139085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:32.396532682 +0000 UTC m=+23.707943295" watchObservedRunningTime="2026-07-09 14:40:32.4139085 +0000 UTC m=+23.725319113" Jul 09 14:40:33.091631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.091604 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:40:33.171048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.170910 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:40:33.091627005Z","UUID":"127b1141-d566-44e2-b8fc-65ef23046ee1","Handler":null,"Name":"","Endpoint":""} Jul 09 14:40:33.172674 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.172640 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:40:33.172674 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.172677 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:40:33.294923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.294840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:33.294923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.294876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:33.295150 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.294840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:33.295150 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:33.294979 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:33.295150 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:33.295066 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:33.295150 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:33.295146 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:33.389838 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:33.389789 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" event={"ID":"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05","Type":"ContainerStarted","Data":"397ba819bbeef6fd6af5607b3532ce62cf44c4436974184aa1a1beded078edf3"} Jul 09 14:40:34.396762 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:34.396703 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"b72c1fe28f441e37625c5c079a7cbb169760eef37aaa0854746d52e02e4e5077"} Jul 09 14:40:35.240553 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.240354 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:35.241053 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.241024 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:35.259086 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.259032 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lth88" podStartSLOduration=6.873161298 podStartE2EDuration="26.259016248s" totalImagesPullingTime="19.38585495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:32.413826509 +0000 UTC m=+23.725237119" watchObservedRunningTime="2026-07-09 14:40:35.259016248 +0000 UTC m=+26.570426858" Jul 09 14:40:35.295003 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.294959 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:35.295003 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.294985 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:35.295236 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:35.295093 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:35.295236 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:35.295179 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:35.295236 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.295219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:35.295388 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:35.295315 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:35.401554 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.401467 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" event={"ID":"d0e77a37-2edd-4f5c-bfd8-ef8017fc9c05","Type":"ContainerStarted","Data":"587c657839b59bb8750644009dbbc69a3232fa131be5f9aab2ea1573bd075cf8"} Jul 09 14:40:35.401986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.401849 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:35.402576 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.402556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-59d2z" Jul 09 14:40:35.419734 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.419676 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9gdj" podStartSLOduration=8.785014724 podStartE2EDuration="26.419661153s" totalImagesPullingTime="17.634646429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:35.419247411 +0000 UTC m=+26.730658022" watchObservedRunningTime="2026-07-09 14:40:35.419661153 +0000 UTC m=+26.731071791" Jul 09 14:40:35.497336 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.497242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:35.578480 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:35.578442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:36.408998 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.408893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" event={"ID":"59f3a0e7-970d-470d-af83-f72080a42e6a","Type":"ContainerStarted","Data":"3d719d785f88c2a7fb6dacac1534b2d971be7aeedf3d2de24557525075d23c9a"} Jul 09 14:40:36.410258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.409592 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:36.410258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.409661 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:36.428375 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.427861 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:36.429047 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.428633 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:36.438392 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:36.438346 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" podStartSLOduration=7.950848974 podStartE2EDuration="27.438328395s" totalImagesPullingTime="19.487479421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:36.437650515 +0000 UTC m=+27.749061108" watchObservedRunningTime="2026-07-09 14:40:36.438328395 +0000 UTC m=+27.749739025" Jul 09 14:40:37.294967 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.294784 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:37.295139 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.294799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:37.295139 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:37.295051 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:37.295139 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.294877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:37.295139 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:37.295116 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:37.295372 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:37.295195 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:37.416052 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.416020 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="6c8ea15faccb68b28ef2b10c5990ff675e0e472519e0429f221f7d32f81fcdc8" exitCode=0 Jul 09 14:40:37.416502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.416108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"6c8ea15faccb68b28ef2b10c5990ff675e0e472519e0429f221f7d32f81fcdc8"} Jul 09 14:40:37.416502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:37.416163 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:40:38.418611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.418583 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:40:38.602785 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.602752 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pxvxg"] Jul 09 14:40:38.602928 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.602886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:38.603023 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:38.602999 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:38.605970 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.605941 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqtsz"] Jul 09 14:40:38.606102 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.606075 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:38.606204 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:38.606177 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:38.606655 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.606621 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wzc2"] Jul 09 14:40:38.606788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.606773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:38.606905 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:38.606884 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:38.802614 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.802582 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:38.901696 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:38.901615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:39.174353 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:39.174262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:39.275575 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:39.275543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:39.424620 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:39.424539 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="2bd7e471843a21eff6a66c3ada49fd93dfcf5af8e1b96d8da9fe42a1cf4aba23" exitCode=0 Jul 09 14:40:39.424978 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:39.424600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"2bd7e471843a21eff6a66c3ada49fd93dfcf5af8e1b96d8da9fe42a1cf4aba23"} Jul 09 14:40:40.200899 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.200681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:40.294715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.294679 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:40.294715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.294715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:40.294921 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.294829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:40.294921 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:40.294841 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:40.295032 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:40.294914 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:40.295032 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:40.294979 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:40.300208 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.300178 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:40.429784 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.429747 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="f631901e2c596a9500e565cc2f9ee6a5d9611f6eb5ef303eef7cdd756ea60ad8" exitCode=0 Jul 09 14:40:40.430119 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:40.429812 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"f631901e2c596a9500e565cc2f9ee6a5d9611f6eb5ef303eef7cdd756ea60ad8"} Jul 09 14:40:41.128032 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:41.127999 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:40:41.128279 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:41.128259 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:40:41.140715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:41.140674 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" podUID="59f3a0e7-970d-470d-af83-f72080a42e6a" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 14:40:41.151760 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:41.151704 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" podUID="59f3a0e7-970d-470d-af83-f72080a42e6a" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 14:40:42.294781 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.294752 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:42.295264 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.294786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:42.295264 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.294790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:42.295264 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.294868 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqtsz" podUID="c7cb48ca-6c63-42d6-941b-2dba6272b82e" Jul 09 14:40:42.295264 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.294974 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pxvxg" podUID="20cbf36b-ad6d-48a1-b0af-d4b7fd747995" Jul 09 14:40:42.295264 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.295075 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:40:42.866640 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.866602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:42.866850 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.866798 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:42.866914 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.866874 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret podName:20cbf36b-ad6d-48a1-b0af-d4b7fd747995 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:14.866853433 +0000 UTC m=+66.178264022 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret") pod "global-pull-secret-syncer-pxvxg" (UID: "20cbf36b-ad6d-48a1-b0af-d4b7fd747995") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:40:42.967472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.967434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:42.967653 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:42.967542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:42.967653 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967615 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:40:42.967653 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967639 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:40:42.967653 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967645 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:42.967653 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967648 2572 projected.go:196] Error preparing data for projected volume kube-api-access-shmkk for pod openshift-network-diagnostics/network-check-target-mqtsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:42.967909 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967700 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk podName:c7cb48ca-6c63-42d6-941b-2dba6272b82e nodeName:}" failed. No retries permitted until 2026-07-09 14:41:14.96768522 +0000 UTC m=+66.279095809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-shmkk" (UniqueName: "kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk") pod "network-check-target-mqtsz" (UID: "c7cb48ca-6c63-42d6-941b-2dba6272b82e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:40:42.967909 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:42.967714 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:41:14.967708159 +0000 UTC m=+66.279118748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:40:43.507796 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.507759 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-95.ec2.internal" event="NodeReady" Jul 09 14:40:43.508191 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.507909 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:40:43.559826 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.559795 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nzf2s"] Jul 09 14:40:43.564579 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.564556 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h6r5w"] Jul 09 14:40:43.564753 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.564712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.567816 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.567794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:40:43.567974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.567926 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7btb\"" Jul 09 14:40:43.568107 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.568085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.568190 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.568165 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:40:43.571494 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.571474 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5rhd4\"" Jul 09 14:40:43.571607 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.571516 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:40:43.571607 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.571546 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:40:43.571824 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.571806 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:40:43.574026 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.574004 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nzf2s"] Jul 09 14:40:43.574990 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.574959 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6r5w"] Jul 09 14:40:43.671922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.671838 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw4lm\" (UniqueName: \"kubernetes.io/projected/2126db22-3b96-4206-a6c5-9d37993faea3-kube-api-access-zw4lm\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.671922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.671877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2126db22-3b96-4206-a6c5-9d37993faea3-config-volume\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.671922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.671919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2126db22-3b96-4206-a6c5-9d37993faea3-tmp-dir\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.672191 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.672030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc5fn\" (UniqueName: \"kubernetes.io/projected/c9f0604a-9d2b-463e-aa85-2046acebeecd-kube-api-access-zc5fn\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.672191 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.672052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f0604a-9d2b-463e-aa85-2046acebeecd-cert\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.672191 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.672069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.772542 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772508 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw4lm\" (UniqueName: \"kubernetes.io/projected/2126db22-3b96-4206-a6c5-9d37993faea3-kube-api-access-zw4lm\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.772756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2126db22-3b96-4206-a6c5-9d37993faea3-config-volume\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.772756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2126db22-3b96-4206-a6c5-9d37993faea3-tmp-dir\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.772756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772648 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc5fn\" (UniqueName: \"kubernetes.io/projected/c9f0604a-9d2b-463e-aa85-2046acebeecd-kube-api-access-zc5fn\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.772756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f0604a-9d2b-463e-aa85-2046acebeecd-cert\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.772756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.772692 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.773014 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:43.772822 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:43.773014 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:43.772885 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:44.272869227 +0000 UTC m=+35.584279834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:40:43.773565 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.773537 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2126db22-3b96-4206-a6c5-9d37993faea3-config-volume\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.773874 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.773851 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2126db22-3b96-4206-a6c5-9d37993faea3-tmp-dir\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.778164 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.778141 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9f0604a-9d2b-463e-aa85-2046acebeecd-cert\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.782046 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.781984 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc5fn\" (UniqueName: \"kubernetes.io/projected/c9f0604a-9d2b-463e-aa85-2046acebeecd-kube-api-access-zc5fn\") pod \"ingress-canary-h6r5w\" (UID: \"c9f0604a-9d2b-463e-aa85-2046acebeecd\") " pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:43.782353 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.782332 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw4lm\" (UniqueName: \"kubernetes.io/projected/2126db22-3b96-4206-a6c5-9d37993faea3-kube-api-access-zw4lm\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:43.886766 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:43.886712 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6r5w" Jul 09 14:40:44.276535 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.276494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:44.276761 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:44.276675 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:44.276761 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:44.276757 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:45.276737307 +0000 UTC m=+36.588147912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:40:44.294627 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.294597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:40:44.294806 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.294597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:40:44.294806 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.294597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:40:44.297811 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.297791 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:40:44.297937 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.297856 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:40:44.299213 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.299195 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:40:44.299213 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.299207 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgrr9\"" Jul 09 14:40:44.299386 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.299242 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d62s8\"" Jul 09 14:40:44.299386 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:44.299346 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:40:45.113860 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:45.113607 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6r5w"] Jul 09 14:40:45.116960 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:40:45.116932 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f0604a_9d2b_463e_aa85_2046acebeecd.slice/crio-e0f3183b8d54bc7ef2efc86ca2656a0af3204c155a869585325b8d7cc35e967e WatchSource:0}: Error finding container e0f3183b8d54bc7ef2efc86ca2656a0af3204c155a869585325b8d7cc35e967e: Status 404 returned error can't find the container with id e0f3183b8d54bc7ef2efc86ca2656a0af3204c155a869585325b8d7cc35e967e Jul 09 14:40:45.285390 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:45.285365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:45.285509 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:45.285492 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:45.285579 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:45.285567 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:47.285544848 +0000 UTC m=+38.596955455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:40:45.444364 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:45.444333 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="d3abd0afb7a7cc80a8572119e5063ede63e4dc13e16b315e4b8495055713563d" exitCode=0 Jul 09 14:40:45.444515 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:45.444414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"d3abd0afb7a7cc80a8572119e5063ede63e4dc13e16b315e4b8495055713563d"} Jul 09 14:40:45.445550 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:45.445525 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6r5w" event={"ID":"c9f0604a-9d2b-463e-aa85-2046acebeecd","Type":"ContainerStarted","Data":"e0f3183b8d54bc7ef2efc86ca2656a0af3204c155a869585325b8d7cc35e967e"} Jul 09 14:40:46.452091 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:46.452057 2572 generic.go:356] "Generic (PLEG): container finished" podID="48144e0e-3d98-4296-8337-91320890268f" containerID="9f9c5802fca75a7517cbf78320a29eb8b2a505be334135f9ee32f406198ed132" exitCode=0 Jul 09 14:40:46.452554 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:46.452124 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerDied","Data":"9f9c5802fca75a7517cbf78320a29eb8b2a505be334135f9ee32f406198ed132"} Jul 09 14:40:47.299989 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:47.299949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:47.300241 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:47.300105 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:47.300241 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:47.300172 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:51.300155455 +0000 UTC m=+42.611566048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:40:47.458064 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:47.458026 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" event={"ID":"48144e0e-3d98-4296-8337-91320890268f","Type":"ContainerStarted","Data":"d316873258f91c9e363c5b5361d0afb5540a06ce22cbed11e92ceb4525ec9881"} Jul 09 14:40:47.483953 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:47.483890 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7mtbz" podStartSLOduration=7.673857741 podStartE2EDuration="38.483868178s" totalImagesPullingTime="30.810010437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:47.481777247 +0000 UTC m=+38.793187858" watchObservedRunningTime="2026-07-09 14:40:47.483868178 +0000 UTC m=+38.795278791" Jul 09 14:40:47.606025 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:47.605944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:47.705084 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:47.705054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:48.275110 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:48.275015 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:48.376226 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:48.376195 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:48.461853 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:48.461819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6r5w" event={"ID":"c9f0604a-9d2b-463e-aa85-2046acebeecd","Type":"ContainerStarted","Data":"87e9334f4722b3bb2051e5baa9009d0c0ffbf8a4f90c7caa984f158c3ac2e3a8"} Jul 09 14:40:48.479381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:48.479336 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h6r5w" podStartSLOduration=2.984987135 podStartE2EDuration="5.479319467s" totalImagesPullingTime="2.494332332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:48.478959544 +0000 UTC m=+39.790370154" watchObservedRunningTime="2026-07-09 14:40:48.479319467 +0000 UTC m=+39.790730078" Jul 09 14:40:49.603601 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:49.603560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:49.705327 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:49.705284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:51.328999 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:51.328962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:51.329375 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:51.329111 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:51.329375 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:51.329173 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:40:59.329154893 +0000 UTC m=+50.640565485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:40:59.385945 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:40:59.385900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:40:59.386348 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:59.386059 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:40:59.386348 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:40:59.386119 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:15.386101911 +0000 UTC m=+66.697512500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:41:00.775166 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:00.775125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:00.876288 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:00.876251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:01.166706 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:01.166627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:01.222370 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:01.222333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:11.150793 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:11.150764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nfzq" Jul 09 14:41:11.275368 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:11.275332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:11.347353 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:11.347324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:14.496976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.496942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:14.554449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.554415 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:14.891036 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.890996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:41:14.894395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.894375 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:41:14.905949 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.905922 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20cbf36b-ad6d-48a1-b0af-d4b7fd747995-original-pull-secret\") pod \"global-pull-secret-syncer-pxvxg\" (UID: \"20cbf36b-ad6d-48a1-b0af-d4b7fd747995\") " pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:41:14.920538 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.920510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pxvxg" Jul 09 14:41:14.992158 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.992118 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:41:14.992344 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.992195 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:41:14.995384 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.995358 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:41:14.995543 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:14.995435 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:41:15.003148 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:15.002839 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:41:15.003148 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:15.002937 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:42:19.002910291 +0000 UTC m=+130.314320891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : secret "metrics-daemon-secret" not found Jul 09 14:41:15.005899 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.005873 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:41:15.017156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.017125 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shmkk\" (UniqueName: \"kubernetes.io/projected/c7cb48ca-6c63-42d6-941b-2dba6272b82e-kube-api-access-shmkk\") pod \"network-check-target-mqtsz\" (UID: \"c7cb48ca-6c63-42d6-941b-2dba6272b82e\") " pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:41:15.085060 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.085027 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pxvxg"] Jul 09 14:41:15.087943 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:41:15.087916 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20cbf36b_ad6d_48a1_b0af_d4b7fd747995.slice/crio-835904d057c2342b06d646c184fec2d59d6e9518da9789e292bc4261a10bfa54 WatchSource:0}: Error finding container 835904d057c2342b06d646c184fec2d59d6e9518da9789e292bc4261a10bfa54: Status 404 returned error can't find the container with id 835904d057c2342b06d646c184fec2d59d6e9518da9789e292bc4261a10bfa54 Jul 09 14:41:15.216568 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.216490 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wgrr9\"" Jul 09 14:41:15.223980 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.223959 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:41:15.379823 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.379787 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqtsz"] Jul 09 14:41:15.382369 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:41:15.382343 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7cb48ca_6c63_42d6_941b_2dba6272b82e.slice/crio-2e561a2fd842237d73b25c22e8c3920f3a765ec3f7cda000393c4133297e8224 WatchSource:0}: Error finding container 2e561a2fd842237d73b25c22e8c3920f3a765ec3f7cda000393c4133297e8224: Status 404 returned error can't find the container with id 2e561a2fd842237d73b25c22e8c3920f3a765ec3f7cda000393c4133297e8224 Jul 09 14:41:15.394641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.394614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:41:15.394821 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:15.394800 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:41:15.394908 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:15.394897 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:41:47.394875549 +0000 UTC m=+98.706286146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:41:15.526313 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.526248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqtsz" event={"ID":"c7cb48ca-6c63-42d6-941b-2dba6272b82e","Type":"ContainerStarted","Data":"2e561a2fd842237d73b25c22e8c3920f3a765ec3f7cda000393c4133297e8224"} Jul 09 14:41:15.527301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:15.527279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pxvxg" event={"ID":"20cbf36b-ad6d-48a1-b0af-d4b7fd747995","Type":"ContainerStarted","Data":"835904d057c2342b06d646c184fec2d59d6e9518da9789e292bc4261a10bfa54"} Jul 09 14:41:20.542995 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:20.542953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqtsz" event={"ID":"c7cb48ca-6c63-42d6-941b-2dba6272b82e","Type":"ContainerStarted","Data":"05a28603f9f9d5a67f30c0330137d7f1cb3252ff0db2620b9ea6bbc4e70680e3"} Jul 09 14:41:20.543483 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:20.543140 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:41:20.544402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:20.544369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pxvxg" event={"ID":"20cbf36b-ad6d-48a1-b0af-d4b7fd747995","Type":"ContainerStarted","Data":"e1613057876ce6cd7296a94ce23fe366dfe744936be37f28c6ef855f80106382"} Jul 09 14:41:20.567094 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:20.567040 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mqtsz" podStartSLOduration=66.59655959 podStartE2EDuration="1m11.567024271s" totalImagesPullingTime="4.970464681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:20.566909791 +0000 UTC m=+71.878320415" watchObservedRunningTime="2026-07-09 14:41:20.567024271 +0000 UTC m=+71.878434883" Jul 09 14:41:20.601106 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:20.601055 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pxvxg" podStartSLOduration=66.332464627 podStartE2EDuration="1m11.601038454s" totalImagesPullingTime="5.268573827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:20.600430226 +0000 UTC m=+71.911840838" watchObservedRunningTime="2026-07-09 14:41:20.601038454 +0000 UTC m=+71.912449042" Jul 09 14:41:37.994985 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:37.994851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:47.407556 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:47.407501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:41:47.408083 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:47.407676 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:41:47.408083 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:41:47.407771 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:42:51.407750996 +0000 UTC m=+162.719161587 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:41:51.549364 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:41:51.549336 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mqtsz" Jul 09 14:42:19.025997 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:42:19.025960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:42:19.026489 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:19.026112 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:42:19.026489 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:19.026191 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:44:21.026173146 +0000 UTC m=+252.337583736 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : secret "metrics-daemon-secret" not found Jul 09 14:42:43.004075 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:42:43.004029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:42:46.579667 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:46.579616 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nzf2s" podUID="2126db22-3b96-4206-a6c5-9d37993faea3" Jul 09 14:42:46.747193 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:42:46.747162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:42:47.306260 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:47.306220 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:42:51.448767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:42:51.448709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:42:51.449239 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:51.448844 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:42:51.449239 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:42:51.448929 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls podName:2126db22-3b96-4206-a6c5-9d37993faea3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:53.44891157 +0000 UTC m=+284.760322159 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls") pod "dns-default-nzf2s" (UID: "2126db22-3b96-4206-a6c5-9d37993faea3") : secret "dns-default-metrics-tls" not found Jul 09 14:42:59.295237 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:42:59.295155 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:43:59.648396 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:43:59.648349 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:11.799065 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:11.799032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:17.199202 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.199167 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4"] Jul 09 14:44:17.200829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.200813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.202458 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.202434 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l"] Jul 09 14:44:17.203624 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.203598 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 14:44:17.203961 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.203944 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 14:44:17.204056 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.203969 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.204056 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.204030 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.204241 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.204224 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-sb2rz"] Jul 09 14:44:17.204281 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.204268 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nlsqb\"" Jul 09 14:44:17.204361 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.204346 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" Jul 09 14:44:17.206188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.206172 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm"] Jul 09 14:44:17.206307 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.206292 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.207471 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.207451 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.207968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.207916 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" Jul 09 14:44:17.208462 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.208443 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.208556 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.208457 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tqhlj\"" Jul 09 14:44:17.208871 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.208854 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h65gd\"" Jul 09 14:44:17.209134 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.209122 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.209898 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.209882 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 14:44:17.210610 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.210596 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.210753 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.210733 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 14:44:17.211389 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.211372 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g6v58\"" Jul 09 14:44:17.216297 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.216280 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 14:44:17.223352 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.223331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8362d60d-f199-41c4-9389-40f49eca7d1c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.223439 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.223377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8362d60d-f199-41c4-9389-40f49eca7d1c-config\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.223439 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.223417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq478\" (UniqueName: \"kubernetes.io/projected/eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46-kube-api-access-zq478\") pod \"volume-data-source-validator-78495597f6-dxv6l\" (UID: \"eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" Jul 09 14:44:17.223533 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.223488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgsvb\" (UniqueName: \"kubernetes.io/projected/8362d60d-f199-41c4-9389-40f49eca7d1c-kube-api-access-mgsvb\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.225361 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.225338 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4"] Jul 09 14:44:17.226815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.226798 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sb2rz"] Jul 09 14:44:17.227470 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.227452 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm"] Jul 09 14:44:17.240498 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.240475 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l"] Jul 09 14:44:17.298559 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.298525 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp"] Jul 09 14:44:17.300364 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.300349 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928"] Jul 09 14:44:17.300484 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.300466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.301904 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.301886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.303518 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.303501 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.303609 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.303502 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 14:44:17.303993 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.303978 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lmg99\"" Jul 09 14:44:17.304698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.304681 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:44:17.305108 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.305091 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 14:44:17.305108 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.305103 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.305207 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.305174 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-l2m5x\"" Jul 09 14:44:17.305319 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.305305 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:44:17.305381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.305310 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 14:44:17.310432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.310403 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp"] Jul 09 14:44:17.323984 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.323962 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928"] Jul 09 14:44:17.324189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324170 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgsvb\" (UniqueName: \"kubernetes.io/projected/8362d60d-f199-41c4-9389-40f49eca7d1c-kube-api-access-mgsvb\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.324266 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.324355 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9z8\" (UniqueName: \"kubernetes.io/projected/79bec70a-ed65-40a4-871d-186bac01bb73-kube-api-access-fw9z8\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.324418 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8362d60d-f199-41c4-9389-40f49eca7d1c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.324472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlg7\" (UniqueName: \"kubernetes.io/projected/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-kube-api-access-lqlg7\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.324528 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-trusted-ca\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.324571 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-config\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.324571 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324567 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.324648 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8362d60d-f199-41c4-9389-40f49eca7d1c-config\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.324691 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9mv\" (UniqueName: \"kubernetes.io/projected/36617a69-f0a2-457c-b6a6-051a3bddac4d-kube-api-access-nz9mv\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.324765 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324691 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.324828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq478\" (UniqueName: \"kubernetes.io/projected/eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46-kube-api-access-zq478\") pod \"volume-data-source-validator-78495597f6-dxv6l\" (UID: \"eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" Jul 09 14:44:17.324828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324788 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bec70a-ed65-40a4-871d-186bac01bb73-serving-cert\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.324828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.324813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95zgc\" (UniqueName: \"kubernetes.io/projected/73daf1c4-fae0-465b-a34d-99c2ac3151d5-kube-api-access-95zgc\") pod \"network-check-source-869dcfcdcd-rd8wm\" (UID: \"73daf1c4-fae0-465b-a34d-99c2ac3151d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" Jul 09 14:44:17.325172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.325152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8362d60d-f199-41c4-9389-40f49eca7d1c-config\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.326891 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.326867 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8362d60d-f199-41c4-9389-40f49eca7d1c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.340290 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.340270 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgsvb\" (UniqueName: \"kubernetes.io/projected/8362d60d-f199-41c4-9389-40f49eca7d1c-kube-api-access-mgsvb\") pod \"service-ca-operator-7695fc6c8c-2qxj4\" (UID: \"8362d60d-f199-41c4-9389-40f49eca7d1c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.344701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.344676 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq478\" (UniqueName: \"kubernetes.io/projected/eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46-kube-api-access-zq478\") pod \"volume-data-source-validator-78495597f6-dxv6l\" (UID: \"eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" Jul 09 14:44:17.425516 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425482 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9mv\" (UniqueName: \"kubernetes.io/projected/36617a69-f0a2-457c-b6a6-051a3bddac4d-kube-api-access-nz9mv\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.425516 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425517 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bec70a-ed65-40a4-871d-186bac01bb73-serving-cert\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95zgc\" (UniqueName: \"kubernetes.io/projected/73daf1c4-fae0-465b-a34d-99c2ac3151d5-kube-api-access-95zgc\") pod \"network-check-source-869dcfcdcd-rd8wm\" (UID: \"73daf1c4-fae0-465b-a34d-99c2ac3151d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425626 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9z8\" (UniqueName: \"kubernetes.io/projected/79bec70a-ed65-40a4-871d-186bac01bb73-kube-api-access-fw9z8\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlg7\" (UniqueName: \"kubernetes.io/projected/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-kube-api-access-lqlg7\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-trusted-ca\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425762 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-config\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.425794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.425784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.426150 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.425821 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:17.426150 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.425884 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:44:17.426300 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.426283 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:17.926260245 +0000 UTC m=+249.237670835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:17.426373 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.426332 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls podName:36617a69-f0a2-457c-b6a6-051a3bddac4d nodeName:}" failed. No retries permitted until 2026-07-09 14:44:17.926310309 +0000 UTC m=+249.237720916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls") pod "cluster-samples-operator-65db858894-pjmxp" (UID: "36617a69-f0a2-457c-b6a6-051a3bddac4d") : secret "samples-operator-tls" not found Jul 09 14:44:17.426851 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.426825 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.427188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.427132 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-config\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.430080 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.429889 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bec70a-ed65-40a4-871d-186bac01bb73-trusted-ca\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.430332 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.430310 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/79bec70a-ed65-40a4-871d-186bac01bb73-serving-cert\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.434418 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.434365 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9mv\" (UniqueName: \"kubernetes.io/projected/36617a69-f0a2-457c-b6a6-051a3bddac4d-kube-api-access-nz9mv\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.435007 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.434986 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95zgc\" (UniqueName: \"kubernetes.io/projected/73daf1c4-fae0-465b-a34d-99c2ac3151d5-kube-api-access-95zgc\") pod \"network-check-source-869dcfcdcd-rd8wm\" (UID: \"73daf1c4-fae0-465b-a34d-99c2ac3151d5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" Jul 09 14:44:17.436278 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.436254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlg7\" (UniqueName: \"kubernetes.io/projected/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-kube-api-access-lqlg7\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.436617 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.436601 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9z8\" (UniqueName: \"kubernetes.io/projected/79bec70a-ed65-40a4-871d-186bac01bb73-kube-api-access-fw9z8\") pod \"console-operator-7866497494-sb2rz\" (UID: \"79bec70a-ed65-40a4-871d-186bac01bb73\") " pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.445820 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.445775 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:17.506120 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.506041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:17.511279 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.511263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" Jul 09 14:44:17.517569 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.517549 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" Jul 09 14:44:17.523356 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.523325 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:17.529231 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.529209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" Jul 09 14:44:17.670172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.670136 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l"] Jul 09 14:44:17.673923 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:17.673881 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4ac7e2_7e46_4dd3_8ae8_c4437776aa46.slice/crio-fe8b53437aee240bf6a6a56d5075919d25347fab7825aaadcf36a25306a9a243 WatchSource:0}: Error finding container fe8b53437aee240bf6a6a56d5075919d25347fab7825aaadcf36a25306a9a243: Status 404 returned error can't find the container with id fe8b53437aee240bf6a6a56d5075919d25347fab7825aaadcf36a25306a9a243 Jul 09 14:44:17.687922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.687897 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4"] Jul 09 14:44:17.691297 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:17.691249 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8362d60d_f199_41c4_9389_40f49eca7d1c.slice/crio-68b2d12285c820b33d6f0fcbc37c2ac2a5ebc248dfb88beb421feb4ae6962350 WatchSource:0}: Error finding container 68b2d12285c820b33d6f0fcbc37c2ac2a5ebc248dfb88beb421feb4ae6962350: Status 404 returned error can't find the container with id 68b2d12285c820b33d6f0fcbc37c2ac2a5ebc248dfb88beb421feb4ae6962350 Jul 09 14:44:17.706480 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.706454 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm"] Jul 09 14:44:17.708885 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:17.708863 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73daf1c4_fae0_465b_a34d_99c2ac3151d5.slice/crio-03a23fdcc1253961182c2b7c2ec37e9dd49b3ddc4cf7eba457b5585b4bc11ece WatchSource:0}: Error finding container 03a23fdcc1253961182c2b7c2ec37e9dd49b3ddc4cf7eba457b5585b4bc11ece: Status 404 returned error can't find the container with id 03a23fdcc1253961182c2b7c2ec37e9dd49b3ddc4cf7eba457b5585b4bc11ece Jul 09 14:44:17.911374 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.911338 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sb2rz"] Jul 09 14:44:17.914082 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:17.914057 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bec70a_ed65_40a4_871d_186bac01bb73.slice/crio-bdca7f1fc8c99042a7a63614a4f3ce4f78942af0da2bdf2846263239eb8219e5 WatchSource:0}: Error finding container bdca7f1fc8c99042a7a63614a4f3ce4f78942af0da2bdf2846263239eb8219e5: Status 404 returned error can't find the container with id bdca7f1fc8c99042a7a63614a4f3ce4f78942af0da2bdf2846263239eb8219e5 Jul 09 14:44:17.929859 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.929837 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:17.929956 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.929901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:17.930012 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.930001 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:17.930058 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.930049 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:18.930035408 +0000 UTC m=+250.241445997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:17.930100 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.930000 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:44:17.930140 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:17.930129 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls podName:36617a69-f0a2-457c-b6a6-051a3bddac4d nodeName:}" failed. No retries permitted until 2026-07-09 14:44:18.930112931 +0000 UTC m=+250.241523525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls") pod "cluster-samples-operator-65db858894-pjmxp" (UID: "36617a69-f0a2-457c-b6a6-051a3bddac4d") : secret "samples-operator-tls" not found Jul 09 14:44:17.972634 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.972597 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" event={"ID":"73daf1c4-fae0-465b-a34d-99c2ac3151d5","Type":"ContainerStarted","Data":"dba20cbd9028155726cad54f142fbaad263b2516985d447119fb533b0f998ee6"} Jul 09 14:44:17.972791 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.972657 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" event={"ID":"73daf1c4-fae0-465b-a34d-99c2ac3151d5","Type":"ContainerStarted","Data":"03a23fdcc1253961182c2b7c2ec37e9dd49b3ddc4cf7eba457b5585b4bc11ece"} Jul 09 14:44:17.973774 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.973746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" event={"ID":"8362d60d-f199-41c4-9389-40f49eca7d1c","Type":"ContainerStarted","Data":"68b2d12285c820b33d6f0fcbc37c2ac2a5ebc248dfb88beb421feb4ae6962350"} Jul 09 14:44:17.974869 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.974852 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sb2rz" event={"ID":"79bec70a-ed65-40a4-871d-186bac01bb73","Type":"ContainerStarted","Data":"bdca7f1fc8c99042a7a63614a4f3ce4f78942af0da2bdf2846263239eb8219e5"} Jul 09 14:44:17.975922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.975905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" event={"ID":"eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46","Type":"ContainerStarted","Data":"fe8b53437aee240bf6a6a56d5075919d25347fab7825aaadcf36a25306a9a243"} Jul 09 14:44:17.990878 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:17.990831 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-rd8wm" podStartSLOduration=0.990817386 podStartE2EDuration="990.817386ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:17.990183714 +0000 UTC m=+249.301594326" watchObservedRunningTime="2026-07-09 14:44:17.990817386 +0000 UTC m=+249.302227997" Jul 09 14:44:18.939070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:18.939012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:18.939517 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:18.939087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:18.939517 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:18.939193 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:18.939517 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:18.939216 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:44:18.939517 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:18.939282 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:20.939257892 +0000 UTC m=+252.250668497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:18.939517 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:18.939306 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls podName:36617a69-f0a2-457c-b6a6-051a3bddac4d nodeName:}" failed. No retries permitted until 2026-07-09 14:44:20.939293698 +0000 UTC m=+252.250704305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls") pod "cluster-samples-operator-65db858894-pjmxp" (UID: "36617a69-f0a2-457c-b6a6-051a3bddac4d") : secret "samples-operator-tls" not found Jul 09 14:44:19.983818 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:19.983784 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" event={"ID":"eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46","Type":"ContainerStarted","Data":"fb23953abb5d51fd3e2b6d8d8db83253b97e26e50242ba895972d09ebe926163"} Jul 09 14:44:20.002231 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:20.002178 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-dxv6l" podStartSLOduration=1.701099256 podStartE2EDuration="3.002162173s" totalImagesPullingTime="1.301062917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:20.001505708 +0000 UTC m=+251.312916318" watchObservedRunningTime="2026-07-09 14:44:20.002162173 +0000 UTC m=+251.313572782" Jul 09 14:44:20.086072 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:20.086036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:20.145643 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:20.145604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:20.955078 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:20.955029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:20.955275 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:20.955160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:20.955275 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:20.955208 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:44:20.955392 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:20.955288 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls podName:36617a69-f0a2-457c-b6a6-051a3bddac4d nodeName:}" failed. No retries permitted until 2026-07-09 14:44:24.955267717 +0000 UTC m=+256.266678318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls") pod "cluster-samples-operator-65db858894-pjmxp" (UID: "36617a69-f0a2-457c-b6a6-051a3bddac4d") : secret "samples-operator-tls" not found Jul 09 14:44:20.955392 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:20.955303 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:20.955392 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:20.955363 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:24.955344784 +0000 UTC m=+256.266755381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:21.056068 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.056042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:44:21.056413 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.056208 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:44:21.056413 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.056268 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs podName:2ccf631e-01f6-4635-8f46-5a410f14643c nodeName:}" failed. No retries permitted until 2026-07-09 14:46:23.056248919 +0000 UTC m=+374.367659514 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs") pod "network-metrics-daemon-2wzc2" (UID: "2ccf631e-01f6-4635-8f46-5a410f14643c") : secret "metrics-daemon-secret" not found Jul 09 14:44:21.772324 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.772282 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj"] Jul 09 14:44:21.774427 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.774405 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" Jul 09 14:44:21.777913 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.777889 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 14:44:21.779204 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.779179 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 14:44:21.779316 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.779209 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lnnjm\"" Jul 09 14:44:21.786209 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.786186 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj"] Jul 09 14:44:21.805419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.805391 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ssnnp"] Jul 09 14:44:21.807426 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.807394 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.810866 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.810841 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:44:21.810978 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.810846 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd2rk\"" Jul 09 14:44:21.811039 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.810984 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:44:21.811039 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.810998 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:44:21.811039 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.810985 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:44:21.820342 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.820317 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ssnnp"] Jul 09 14:44:21.822332 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.822304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:21.862539 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862500 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6968e1-7f60-41b0-8204-49a824957887-crio-socket\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.862539 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.862788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59pdx\" (UniqueName: \"kubernetes.io/projected/6f6968e1-7f60-41b0-8204-49a824957887-kube-api-access-59pdx\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.862788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.862788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862651 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6968e1-7f60-41b0-8204-49a824957887-data-volume\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.862788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.862686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jks2w\" (UniqueName: \"kubernetes.io/projected/0af03724-c9a7-4038-a197-a91ca94574b1-kube-api-access-jks2w\") pod \"migrator-7f59b54f6c-2qrjj\" (UID: \"0af03724-c9a7-4038-a197-a91ca94574b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" Jul 09 14:44:21.963823 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jks2w\" (UniqueName: \"kubernetes.io/projected/0af03724-c9a7-4038-a197-a91ca94574b1-kube-api-access-jks2w\") pod \"migrator-7f59b54f6c-2qrjj\" (UID: \"0af03724-c9a7-4038-a197-a91ca94574b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" Jul 09 14:44:21.964002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6968e1-7f60-41b0-8204-49a824957887-crio-socket\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59pdx\" (UniqueName: \"kubernetes.io/projected/6f6968e1-7f60-41b0-8204-49a824957887-kube-api-access-59pdx\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.963956 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6968e1-7f60-41b0-8204-49a824957887-data-volume\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964231 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.963996 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:21.964231 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.964062 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f6968e1-7f60-41b0-8204-49a824957887-crio-socket\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.964231 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.964075 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:21.964231 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.964085 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:22.464064867 +0000 UTC m=+253.775475460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : configmap "kube-rbac-proxy" not found Jul 09 14:44:21.964231 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:21.964152 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:22.464131898 +0000 UTC m=+253.775542492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:21.964395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.964287 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f6968e1-7f60-41b0-8204-49a824957887-data-volume\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.974581 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.974550 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59pdx\" (UniqueName: \"kubernetes.io/projected/6f6968e1-7f60-41b0-8204-49a824957887-kube-api-access-59pdx\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:21.974581 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.974568 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jks2w\" (UniqueName: \"kubernetes.io/projected/0af03724-c9a7-4038-a197-a91ca94574b1-kube-api-access-jks2w\") pod \"migrator-7f59b54f6c-2qrjj\" (UID: \"0af03724-c9a7-4038-a197-a91ca94574b1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" Jul 09 14:44:21.979954 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.979920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:21.991314 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.991278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" event={"ID":"8362d60d-f199-41c4-9389-40f49eca7d1c","Type":"ContainerStarted","Data":"dbc07b951371f4fa63b3e8b6497cddcf364c105fe7931ad1d922b9a81b0293ca"} Jul 09 14:44:21.993031 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.993007 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/0.log" Jul 09 14:44:21.993168 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.993046 2572 generic.go:356] "Generic (PLEG): container finished" podID="79bec70a-ed65-40a4-871d-186bac01bb73" containerID="6b8749d4a177388e57ab9973ba4cf93f35fd2c72ed571c8e43af8317789a4412" exitCode=255 Jul 09 14:44:21.993168 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.993074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sb2rz" event={"ID":"79bec70a-ed65-40a4-871d-186bac01bb73","Type":"ContainerDied","Data":"6b8749d4a177388e57ab9973ba4cf93f35fd2c72ed571c8e43af8317789a4412"} Jul 09 14:44:21.993297 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:21.993284 2572 scope.go:117] "RemoveContainer" containerID="6b8749d4a177388e57ab9973ba4cf93f35fd2c72ed571c8e43af8317789a4412" Jul 09 14:44:22.008234 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.008188 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" podStartSLOduration=1.704722281 podStartE2EDuration="5.008167006s" totalImagesPullingTime="3.303444725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:22.00766474 +0000 UTC m=+253.319075352" watchObservedRunningTime="2026-07-09 14:44:22.008167006 +0000 UTC m=+253.319577611" Jul 09 14:44:22.083918 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.083879 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" Jul 09 14:44:22.223367 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.223340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj"] Jul 09 14:44:22.225927 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:22.225896 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af03724_c9a7_4038_a197_a91ca94574b1.slice/crio-9e64b5003007afc4216dd5a068520fb5544866baa97c3d4cb0da9beb9f145f25 WatchSource:0}: Error finding container 9e64b5003007afc4216dd5a068520fb5544866baa97c3d4cb0da9beb9f145f25: Status 404 returned error can't find the container with id 9e64b5003007afc4216dd5a068520fb5544866baa97c3d4cb0da9beb9f145f25 Jul 09 14:44:22.467485 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.467395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:22.467485 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.467437 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:22.467669 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:22.467533 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:22.467669 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:22.467552 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:22.467669 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:22.467606 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:23.467587876 +0000 UTC m=+254.778998465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : configmap "kube-rbac-proxy" not found Jul 09 14:44:22.467669 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:22.467621 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:23.467614932 +0000 UTC m=+254.779025520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:22.731545 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.731446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:22.786777 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.786736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:22.999181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:22.999089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" event={"ID":"0af03724-c9a7-4038-a197-a91ca94574b1","Type":"ContainerStarted","Data":"9e64b5003007afc4216dd5a068520fb5544866baa97c3d4cb0da9beb9f145f25"} Jul 09 14:44:23.001016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.000992 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/1.log" Jul 09 14:44:23.001438 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.001423 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/0.log" Jul 09 14:44:23.001551 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.001457 2572 generic.go:356] "Generic (PLEG): container finished" podID="79bec70a-ed65-40a4-871d-186bac01bb73" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" exitCode=255 Jul 09 14:44:23.001593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.001556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sb2rz" event={"ID":"79bec70a-ed65-40a4-871d-186bac01bb73","Type":"ContainerDied","Data":"27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593"} Jul 09 14:44:23.001627 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.001609 2572 scope.go:117] "RemoveContainer" containerID="6b8749d4a177388e57ab9973ba4cf93f35fd2c72ed571c8e43af8317789a4412" Jul 09 14:44:23.001984 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.001898 2572 scope.go:117] "RemoveContainer" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" Jul 09 14:44:23.002096 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:23.002040 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:44:23.218010 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.217975 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:23.319502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.319459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:23.476592 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.476550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:23.476592 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.476606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:23.476881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:23.476706 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:23.476881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:23.476805 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:23.476881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:23.476815 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.476788258 +0000 UTC m=+256.788198851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : configmap "kube-rbac-proxy" not found Jul 09 14:44:23.476881 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:23.476862 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:25.476843322 +0000 UTC m=+256.788253928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:23.580610 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.580434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:23.681608 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:23.681538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:24.008983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.008884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" event={"ID":"0af03724-c9a7-4038-a197-a91ca94574b1","Type":"ContainerStarted","Data":"93b0769dce04bbebd28e8c4075c7a6823cec8dc1990a03c859b50d794088d46a"} Jul 09 14:44:24.008983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.008949 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" event={"ID":"0af03724-c9a7-4038-a197-a91ca94574b1","Type":"ContainerStarted","Data":"117ab22f69793aecdab1780455cce0abc9eb1e1bf4f1cc0e3fcfa1957d0afcd8"} Jul 09 14:44:24.010392 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.010371 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/1.log" Jul 09 14:44:24.010699 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.010682 2572 scope.go:117] "RemoveContainer" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" Jul 09 14:44:24.010885 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:24.010865 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:44:24.025174 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.025112 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2qrjj" podStartSLOduration=1.743207624 podStartE2EDuration="3.025096113s" totalImagesPullingTime="1.281888489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:24.024091275 +0000 UTC m=+255.335501890" watchObservedRunningTime="2026-07-09 14:44:24.025096113 +0000 UTC m=+255.336506724" Jul 09 14:44:24.103217 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.103185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:24.160701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.160663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:24.405402 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.405376 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5bsh_15512653-13ed-4961-99d1-e3babbf24bf7/dns-node-resolver/0.log" Jul 09 14:44:24.989109 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.989064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:24.989285 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:24.989152 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:24.989285 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:24.989202 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:24.989285 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:24.989262 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 14:44:24.989285 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:24.989276 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:32.989255036 +0000 UTC m=+264.300665626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:24.989476 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:24.989305 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls podName:36617a69-f0a2-457c-b6a6-051a3bddac4d nodeName:}" failed. No retries permitted until 2026-07-09 14:44:32.989293542 +0000 UTC m=+264.300704130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls") pod "cluster-samples-operator-65db858894-pjmxp" (UID: "36617a69-f0a2-457c-b6a6-051a3bddac4d") : secret "samples-operator-tls" not found Jul 09 14:44:25.201976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:25.201944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:25.294902 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:25.294869 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:25.405405 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:25.405373 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpmkm_6052396f-0d1f-4c75-a63b-2c7b4592e724/node-ca/0.log" Jul 09 14:44:25.492972 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:25.492929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:25.492972 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:25.492979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:25.493401 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:25.493067 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:25.493401 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:25.493129 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:25.493401 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:25.493154 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:29.493133187 +0000 UTC m=+260.804543798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : configmap "kube-rbac-proxy" not found Jul 09 14:44:25.493401 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:25.493174 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:29.493164759 +0000 UTC m=+260.804575358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:26.040347 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:26.040309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:26.205961 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:26.205923 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6r5w_c9f0604a-9d2b-463e-aa85-2046acebeecd/serve-healthcheck-canary/0.log" Jul 09 14:44:26.806852 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:26.806823 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qrjj_0af03724-c9a7-4038-a197-a91ca94574b1/migrator/0.log" Jul 09 14:44:27.005873 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:27.005847 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qrjj_0af03724-c9a7-4038-a197-a91ca94574b1/graceful-termination/0.log" Jul 09 14:44:27.523622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:27.523591 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:27.523780 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:27.523648 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:27.523984 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:27.523973 2572 scope.go:117] "RemoveContainer" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" Jul 09 14:44:27.524128 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:27.524110 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:44:29.237652 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.237564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:29.525509 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.525476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:29.525689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.525519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:29.525689 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:29.525630 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:29.525689 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:29.525636 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:44:29.525689 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:29.525686 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:37.525672405 +0000 UTC m=+268.837082994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:29.525910 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:29.525711 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:37.525691411 +0000 UTC m=+268.837102021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : configmap "kube-rbac-proxy" not found Jul 09 14:44:29.540221 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.540191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:29.759416 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.759371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:29.880637 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.880544 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:29.976407 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:29.976374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:30.134649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:30.134563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:30.429909 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:30.429815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:30.617070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:30.617033 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:31.625886 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:31.625851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:32.020796 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:32.020681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:32.264387 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:32.264352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:32.425432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:32.425399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:32.618906 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:32.618878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:33.053929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.053896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:33.054329 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.053971 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:33.054329 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:33.054060 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:33.054329 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:33.054132 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls podName:9c3cff45-8900-4f7c-8467-eb13dc4e9cf3 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:49.054112581 +0000 UTC m=+280.365523171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gk928" (UID: "9c3cff45-8900-4f7c-8467-eb13dc4e9cf3") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:44:33.056527 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.056494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36617a69-f0a2-457c-b6a6-051a3bddac4d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pjmxp\" (UID: \"36617a69-f0a2-457c-b6a6-051a3bddac4d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:33.210698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.210653 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" Jul 09 14:44:33.335285 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.335214 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp"] Jul 09 14:44:33.422924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.422892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:33.476462 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.476428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:33.668368 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.668262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:33.819116 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:33.819056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:34.041772 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:34.041742 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" event={"ID":"36617a69-f0a2-457c-b6a6-051a3bddac4d","Type":"ContainerStarted","Data":"2b31eb56dcad127e07f57e3cb39d3bee984714c07d55ac1b841a37d4ca5a7d2a"} Jul 09 14:44:34.227290 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:34.227219 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:34.439388 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:34.439290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:34.824239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:34.824200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:34.941133 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:34.941079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:35.422322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:35.422291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:35.817241 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:35.817201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:36.034105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.034061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:36.050370 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.050339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" event={"ID":"36617a69-f0a2-457c-b6a6-051a3bddac4d","Type":"ContainerStarted","Data":"7ae4df22500d4fe5c0fdfb9c841c112146c118df968762fe9cf50759530cec51"} Jul 09 14:44:36.050559 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.050400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" event={"ID":"36617a69-f0a2-457c-b6a6-051a3bddac4d","Type":"ContainerStarted","Data":"dc1a8615b2f8e70bf4343dc96580cf102b8dcb3028f9f5efa548002cd5273b11"} Jul 09 14:44:36.069756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.069650 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pjmxp" podStartSLOduration=17.134714395 podStartE2EDuration="19.069634097s" totalImagesPullingTime="1.934919702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:36.068815064 +0000 UTC m=+267.380225695" watchObservedRunningTime="2026-07-09 14:44:36.069634097 +0000 UTC m=+267.381044714" Jul 09 14:44:36.225087 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.225046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:36.622186 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:36.622141 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:37.028583 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.028549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:37.420980 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.420893 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:37.593571 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.593518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:37.593571 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.593574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:37.593824 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:37.593706 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:44:37.593824 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:37.593798 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls podName:6f6968e1-7f60-41b0-8204-49a824957887 nodeName:}" failed. No retries permitted until 2026-07-09 14:44:53.593781107 +0000 UTC m=+284.905191704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssnnp" (UID: "6f6968e1-7f60-41b0-8204-49a824957887") : secret "insights-runtime-extractor-tls" not found Jul 09 14:44:37.594094 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.594073 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f6968e1-7f60-41b0-8204-49a824957887-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:37.619657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.619625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:37.720635 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:37.720535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:38.020970 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:38.020880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:38.621857 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:38.621808 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:39.022419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:39.022390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:39.422828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:39.422713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:39.830688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:39.830624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:40.017882 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:40.017846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:40.219631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:40.219548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:42.295184 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:42.295149 2572 scope.go:117] "RemoveContainer" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" Jul 09 14:44:43.071783 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.071755 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:44:43.072171 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.072157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/1.log" Jul 09 14:44:43.072229 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.072193 2572 generic.go:356] "Generic (PLEG): container finished" podID="79bec70a-ed65-40a4-871d-186bac01bb73" containerID="39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2" exitCode=255 Jul 09 14:44:43.072271 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.072252 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sb2rz" event={"ID":"79bec70a-ed65-40a4-871d-186bac01bb73","Type":"ContainerDied","Data":"39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2"} Jul 09 14:44:43.072325 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.072312 2572 scope.go:117] "RemoveContainer" containerID="27b2aea2f27df0fca512ebfacd3afbc5db7e619bedd6d8c42123e7e10199d593" Jul 09 14:44:43.072622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:43.072604 2572 scope.go:117] "RemoveContainer" containerID="39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2" Jul 09 14:44:43.072836 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:43.072812 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:44:44.076309 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:44.076280 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:44:46.001973 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:46.001941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:46.102900 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:46.102868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:47.524284 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:47.524254 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:47.524769 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:47.524340 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:44:47.524769 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:47.524648 2572 scope.go:117] "RemoveContainer" containerID="39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2" Jul 09 14:44:47.524852 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:47.524832 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:44:48.122645 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.122611 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7"] Jul 09 14:44:48.125185 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.125160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.128018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.127997 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:44:48.128139 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.128090 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:44:48.129458 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.129443 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:44:48.129554 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.129472 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hz89z\"" Jul 09 14:44:48.133466 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.133444 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:44:48.137908 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.137886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7"] Jul 09 14:44:48.169659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.169622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:48.271773 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.271739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:48.281805 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.281774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-bound-sa-token\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.281968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.281812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-trusted-ca\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.281968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.281893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-image-registry-private-configuration\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.281968 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.281953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-ca-trust-extracted\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.282120 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.281973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-installation-pull-secrets\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.282120 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.282047 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpv5c\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-kube-api-access-bpv5c\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.282222 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.282126 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-certificates\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.282222 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.282166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-tls\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.371734 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.371673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:48.382839 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.382775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-ca-trust-extracted\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.382839 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.382813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-installation-pull-secrets\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.382839 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.382836 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpv5c\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-kube-api-access-bpv5c\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383030 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.382914 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-certificates\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383030 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.382955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-tls\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383030 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.383000 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-bound-sa-token\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383170 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.383036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-trusted-ca\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383170 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.383066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-image-registry-private-configuration\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383262 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.383196 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-ca-trust-extracted\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.383841 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.383808 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-certificates\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.384181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.384156 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-trusted-ca\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.385452 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.385420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-installation-pull-secrets\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.385574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.385557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-image-registry-private-configuration\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.385787 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.385769 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-registry-tls\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.393037 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.393017 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-bound-sa-token\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.393258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.393242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpv5c\" (UniqueName: \"kubernetes.io/projected/4b9b8b52-756d-4a13-ac2d-2c054c8baf24-kube-api-access-bpv5c\") pod \"image-registry-6dcf7c4dcd-tcfv7\" (UID: \"4b9b8b52-756d-4a13-ac2d-2c054c8baf24\") " pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.435263 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.435232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:48.563343 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:48.563308 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7"] Jul 09 14:44:48.566168 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:48.566142 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9b8b52_756d_4a13_ac2d_2c054c8baf24.slice/crio-624209f132c10e3b1e6ceb69c6212554ec35aeeba70c06463ef56010b11f17f7 WatchSource:0}: Error finding container 624209f132c10e3b1e6ceb69c6212554ec35aeeba70c06463ef56010b11f17f7: Status 404 returned error can't find the container with id 624209f132c10e3b1e6ceb69c6212554ec35aeeba70c06463ef56010b11f17f7 Jul 09 14:44:49.089139 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.089100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:49.091684 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.091660 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c3cff45-8900-4f7c-8467-eb13dc4e9cf3-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gk928\" (UID: \"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:49.093048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.093023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" event={"ID":"4b9b8b52-756d-4a13-ac2d-2c054c8baf24","Type":"ContainerStarted","Data":"05a13089ab7431d84abe14d8bdf4c6abb72e1ea04157375d47cc2fe251962422"} Jul 09 14:44:49.093122 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.093072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" event={"ID":"4b9b8b52-756d-4a13-ac2d-2c054c8baf24","Type":"ContainerStarted","Data":"624209f132c10e3b1e6ceb69c6212554ec35aeeba70c06463ef56010b11f17f7"} Jul 09 14:44:49.093176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.093119 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:44:49.113047 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.113003 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" podStartSLOduration=1.112989951 podStartE2EDuration="1.112989951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:49.111983945 +0000 UTC m=+280.423394568" watchObservedRunningTime="2026-07-09 14:44:49.112989951 +0000 UTC m=+280.424400633" Jul 09 14:44:49.117399 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.117384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" Jul 09 14:44:49.241740 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:49.241694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928"] Jul 09 14:44:49.243877 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:49.243845 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3cff45_8900_4f7c_8467_eb13dc4e9cf3.slice/crio-80875594b6e4a2e20e08506532c114c05c40c3ae8f8ed5f45e4ebb93fc222395 WatchSource:0}: Error finding container 80875594b6e4a2e20e08506532c114c05c40c3ae8f8ed5f45e4ebb93fc222395: Status 404 returned error can't find the container with id 80875594b6e4a2e20e08506532c114c05c40c3ae8f8ed5f45e4ebb93fc222395 Jul 09 14:44:49.748228 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:44:49.748195 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nzf2s" podUID="2126db22-3b96-4206-a6c5-9d37993faea3" Jul 09 14:44:50.098230 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:50.098189 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" event={"ID":"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3","Type":"ContainerStarted","Data":"80875594b6e4a2e20e08506532c114c05c40c3ae8f8ed5f45e4ebb93fc222395"} Jul 09 14:44:50.098230 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:50.098228 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:44:51.103551 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.103516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" event={"ID":"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3","Type":"ContainerStarted","Data":"9696f4e6502d62033dc030ace1f85ce0ebf5a949952f5d810aa9d409b62bf822"} Jul 09 14:44:51.119822 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.119776 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" podStartSLOduration=32.352625074 podStartE2EDuration="34.119760284s" totalImagesPullingTime="1.76713521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:51.119110152 +0000 UTC m=+282.430520817" watchObservedRunningTime="2026-07-09 14:44:51.119760284 +0000 UTC m=+282.431170895" Jul 09 14:44:51.330441 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.330400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:51.439461 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.439428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:51.528284 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.528248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:51.669391 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:51.669302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:53.526069 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.526033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:44:53.528380 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.528354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2126db22-3b96-4206-a6c5-9d37993faea3-metrics-tls\") pod \"dns-default-nzf2s\" (UID: \"2126db22-3b96-4206-a6c5-9d37993faea3\") " pod="openshift-dns/dns-default-nzf2s" Jul 09 14:44:53.626704 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.626645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:53.629101 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.629078 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f6968e1-7f60-41b0-8204-49a824957887-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssnnp\" (UID: \"6f6968e1-7f60-41b0-8204-49a824957887\") " pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:53.701838 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.701794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k7btb\"" Jul 09 14:44:53.709332 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.709310 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:44:53.836072 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.836040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nzf2s"] Jul 09 14:44:53.838967 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:53.838942 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2126db22_3b96_4206_a6c5_9d37993faea3.slice/crio-4be0ce012a3c60c33c14423b5d08b8f3f145be95d4b1f3237088db47522446a5 WatchSource:0}: Error finding container 4be0ce012a3c60c33c14423b5d08b8f3f145be95d4b1f3237088db47522446a5: Status 404 returned error can't find the container with id 4be0ce012a3c60c33c14423b5d08b8f3f145be95d4b1f3237088db47522446a5 Jul 09 14:44:53.917471 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:53.917431 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ssnnp" Jul 09 14:44:54.044037 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.044016 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ssnnp"] Jul 09 14:44:54.046379 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:44:54.046354 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6968e1_7f60_41b0_8204_49a824957887.slice/crio-6d7d70b24494abf4450f857fc1a059422a5c3dad3aa9174872770b8811076689 WatchSource:0}: Error finding container 6d7d70b24494abf4450f857fc1a059422a5c3dad3aa9174872770b8811076689: Status 404 returned error can't find the container with id 6d7d70b24494abf4450f857fc1a059422a5c3dad3aa9174872770b8811076689 Jul 09 14:44:54.113769 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.113738 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssnnp" event={"ID":"6f6968e1-7f60-41b0-8204-49a824957887","Type":"ContainerStarted","Data":"6d7d70b24494abf4450f857fc1a059422a5c3dad3aa9174872770b8811076689"} Jul 09 14:44:54.114783 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.114753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nzf2s" event={"ID":"2126db22-3b96-4206-a6c5-9d37993faea3","Type":"ContainerStarted","Data":"4be0ce012a3c60c33c14423b5d08b8f3f145be95d4b1f3237088db47522446a5"} Jul 09 14:44:54.531834 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.531800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:54.596813 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.596759 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:54.681371 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:54.681295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:58.133145 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:58.133106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssnnp" event={"ID":"6f6968e1-7f60-41b0-8204-49a824957887","Type":"ContainerStarted","Data":"a6e60a524b0e111f0fb619731a7deca2f00c3be9b72b9a6d0b1eb3166713a352"} Jul 09 14:44:58.134549 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:58.134517 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nzf2s" event={"ID":"2126db22-3b96-4206-a6c5-9d37993faea3","Type":"ContainerStarted","Data":"58cd3db3b759aec2e6f40fd40ac8896d2ed99cb54f47b68cc8099ea013ed969d"} Jul 09 14:44:58.598461 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:58.598431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:59.140789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:59.140758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssnnp" event={"ID":"6f6968e1-7f60-41b0-8204-49a824957887","Type":"ContainerStarted","Data":"3723e2a35ba38fdb8962bf02db2688c35e2b94178fe74107a0c3c870b9c1b33f"} Jul 09 14:44:59.142514 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:59.142473 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nzf2s" event={"ID":"2126db22-3b96-4206-a6c5-9d37993faea3","Type":"ContainerStarted","Data":"30ac78eda17c387a06e49b883c04450e602ff205016df8977045cddf7dc643bc"} Jul 09 14:44:59.142630 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:59.142611 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:44:59.161731 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:44:59.161682 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nzf2s" podStartSLOduration=252.024546902 podStartE2EDuration="4m16.161665922s" totalImagesPullingTime="4.13711902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:59.160763508 +0000 UTC m=+290.472174119" watchObservedRunningTime="2026-07-09 14:44:59.161665922 +0000 UTC m=+290.473076532" Jul 09 14:45:00.666172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:00.666137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:00.896957 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:00.896921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:01.295119 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:01.295088 2572 scope.go:117] "RemoveContainer" containerID="39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2" Jul 09 14:45:01.295330 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:01.295291 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-sb2rz_openshift-console-operator(79bec70a-ed65-40a4-871d-186bac01bb73)\"" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podUID="79bec70a-ed65-40a4-871d-186bac01bb73" Jul 09 14:45:02.156528 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.156498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:45:02.156983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.156538 2572 generic.go:356] "Generic (PLEG): container finished" podID="9c3cff45-8900-4f7c-8467-eb13dc4e9cf3" containerID="9696f4e6502d62033dc030ace1f85ce0ebf5a949952f5d810aa9d409b62bf822" exitCode=2 Jul 09 14:45:02.156983 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.156629 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" event={"ID":"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3","Type":"ContainerDied","Data":"9696f4e6502d62033dc030ace1f85ce0ebf5a949952f5d810aa9d409b62bf822"} Jul 09 14:45:02.157119 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.157021 2572 scope.go:117] "RemoveContainer" containerID="9696f4e6502d62033dc030ace1f85ce0ebf5a949952f5d810aa9d409b62bf822" Jul 09 14:45:02.158646 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.158623 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssnnp" event={"ID":"6f6968e1-7f60-41b0-8204-49a824957887","Type":"ContainerStarted","Data":"35751dd2b96a7f4070cbc9a6d2e8cdaeedb35a63743ae8848f4d573f33c22f5c"} Jul 09 14:45:02.195741 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:02.195651 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ssnnp" podStartSLOduration=33.734223976 podStartE2EDuration="41.195629106s" totalImagesPullingTime="7.46140513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:44:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:02.195092043 +0000 UTC m=+293.506502674" watchObservedRunningTime="2026-07-09 14:45:02.195629106 +0000 UTC m=+293.507039718" Jul 09 14:45:02.296860 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:02.296812 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2wzc2" podUID="2ccf631e-01f6-4635-8f46-5a410f14643c" Jul 09 14:45:03.163130 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:03.163102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:45:03.163500 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:03.163220 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gk928" event={"ID":"9c3cff45-8900-4f7c-8467-eb13dc4e9cf3","Type":"ContainerStarted","Data":"27c0252b900a3818e7ed8cd543213f4f9f599384ddde92e28b18e8387f9a1a70"} Jul 09 14:45:05.869557 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.869523 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-479bn"] Jul 09 14:45:05.872811 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.872790 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.876097 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.876070 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:45:05.877617 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.877592 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:45:05.877617 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.877609 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4wfv\"" Jul 09 14:45:05.877820 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.877625 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:45:05.877820 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.877603 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:45:05.890704 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.890673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:05.922111 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-sys\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922111 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmqzg\" (UniqueName: \"kubernetes.io/projected/ede8fa35-a392-4d60-b43a-95f575ff732a-kube-api-access-pmqzg\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-root\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922175 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-metrics-client-ca\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-textfile\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-accelerators-collector-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922448 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.922448 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.922331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-wtmp\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:05.981687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:05.981655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.022811 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-accelerators-collector-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022847 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-wtmp\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-sys\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmqzg\" (UniqueName: \"kubernetes.io/projected/ede8fa35-a392-4d60-b43a-95f575ff732a-kube-api-access-pmqzg\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-root\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-sys\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.022965 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023012 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-metrics-client-ca\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023399 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-root\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023399 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023030 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-wtmp\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023399 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:06.023074 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:45:06.023399 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-textfile\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023399 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:06.023126 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls podName:ede8fa35-a392-4d60-b43a-95f575ff732a nodeName:}" failed. No retries permitted until 2026-07-09 14:45:06.523110014 +0000 UTC m=+297.834520629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls") pod "node-exporter-479bn" (UID: "ede8fa35-a392-4d60-b43a-95f575ff732a") : secret "node-exporter-tls" not found Jul 09 14:45:06.023611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023445 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-accelerators-collector-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023459 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-textfile\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.023611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.023603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede8fa35-a392-4d60-b43a-95f575ff732a-metrics-client-ca\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.025282 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.025264 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.033062 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.033038 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmqzg\" (UniqueName: \"kubernetes.io/projected/ede8fa35-a392-4d60-b43a-95f575ff732a-kube-api-access-pmqzg\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.157744 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.157627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.258519 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.258479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.387981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.387951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.497285 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.497188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.527289 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.527245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.529619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.529597 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ede8fa35-a392-4d60-b43a-95f575ff732a-node-exporter-tls\") pod \"node-exporter-479bn\" (UID: \"ede8fa35-a392-4d60-b43a-95f575ff732a\") " pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.588874 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.588828 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.689746 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.689688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.782270 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.782238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-479bn" Jul 09 14:45:06.794662 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:45:06.794633 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede8fa35_a392_4d60_b43a_95f575ff732a.slice/crio-0d061301987d25c46cf921659efcdd2492edaaf685f76ffdf788fe4209b156a3 WatchSource:0}: Error finding container 0d061301987d25c46cf921659efcdd2492edaaf685f76ffdf788fe4209b156a3: Status 404 returned error can't find the container with id 0d061301987d25c46cf921659efcdd2492edaaf685f76ffdf788fe4209b156a3 Jul 09 14:45:06.827693 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.827651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.902532 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.902499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:06.909763 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.909707 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:45:06.913348 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.913331 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.916345 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.916318 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:45:06.917482 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917460 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:45:06.917610 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917590 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:45:06.917703 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917635 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:45:06.917703 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917597 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:45:06.917830 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:45:06.917891 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917827 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:45:06.917891 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.917864 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:45:06.918255 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.918239 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:45:06.918255 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.918249 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6m9p6\"" Jul 09 14:45:06.928547 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.928523 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:45:06.931343 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931319 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931459 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931459 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931715 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lrmn\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931762 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931793 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:06.931829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:06.931821 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.023979 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.023937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:07.032561 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032485 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032561 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032561 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032550 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032804 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032575 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032804 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032890 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032890 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032882 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032971 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lrmn\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.032971 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.033072 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.032990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.033126 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:07.033094 2572 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 14:45:07.033184 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:07.033153 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls podName:5947d57c-993a-4311-9a09-73bec5ed91f5 nodeName:}" failed. No retries permitted until 2026-07-09 14:45:07.533132856 +0000 UTC m=+298.844543459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5") : secret "alertmanager-main-tls" not found Jul 09 14:45:07.033243 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.033197 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.034051 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.033609 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.034051 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.033643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.034051 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.033676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.034051 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.033707 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.034335 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:45:07.034155 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle podName:5947d57c-993a-4311-9a09-73bec5ed91f5 nodeName:}" failed. No retries permitted until 2026-07-09 14:45:07.534135863 +0000 UTC m=+298.845546468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5") : configmap references non-existent config key: ca-bundle.crt Jul 09 14:45:07.036347 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.036322 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.036347 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.036337 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.036795 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.036760 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.036896 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.036808 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.037006 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.036983 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.037104 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.037085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.037208 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.037189 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.037994 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.037971 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.043017 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.042992 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lrmn\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.123096 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.123037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:07.178828 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.178793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-479bn" event={"ID":"ede8fa35-a392-4d60-b43a-95f575ff732a","Type":"ContainerStarted","Data":"0d061301987d25c46cf921659efcdd2492edaaf685f76ffdf788fe4209b156a3"} Jul 09 14:45:07.234265 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.234224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:07.539896 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.539864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.540055 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.539926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.540760 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.540735 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.542406 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.542353 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.824587 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.824398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:45:07.978309 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:07.978279 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:45:07.979313 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:45:07.979286 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5947d57c_993a_4311_9a09_73bec5ed91f5.slice/crio-fc3a73272f90a3eeff89f5b259384fd0d064ed6f95e21b6b3be97386b71e3e21 WatchSource:0}: Error finding container fc3a73272f90a3eeff89f5b259384fd0d064ed6f95e21b6b3be97386b71e3e21: Status 404 returned error can't find the container with id fc3a73272f90a3eeff89f5b259384fd0d064ed6f95e21b6b3be97386b71e3e21 Jul 09 14:45:08.183920 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:08.183839 2572 generic.go:356] "Generic (PLEG): container finished" podID="ede8fa35-a392-4d60-b43a-95f575ff732a" containerID="3ebcf0531c633875d2b9b9d1cd768a472630182be30a5c9fec61185a09c1d438" exitCode=0 Jul 09 14:45:08.184090 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:08.183925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-479bn" event={"ID":"ede8fa35-a392-4d60-b43a-95f575ff732a","Type":"ContainerDied","Data":"3ebcf0531c633875d2b9b9d1cd768a472630182be30a5c9fec61185a09c1d438"} Jul 09 14:45:08.185227 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:08.185203 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"fc3a73272f90a3eeff89f5b259384fd0d064ed6f95e21b6b3be97386b71e3e21"} Jul 09 14:45:08.851786 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:08.851705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:08.951627 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:08.951585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:09.052294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.052258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:09.108020 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.107950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:45:09.108183 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.108137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:45:09.110606 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.110586 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:45:09.110935 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.110912 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:45:09.129370 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.129341 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:45:09.148975 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.148945 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nzf2s" Jul 09 14:45:09.192430 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.192395 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-479bn" event={"ID":"ede8fa35-a392-4d60-b43a-95f575ff732a","Type":"ContainerStarted","Data":"4cd7d1d10233dcf63bb4c41f8fd5254585479d1917564c251f7d54added60b7e"} Jul 09 14:45:09.192596 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.192459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-479bn" event={"ID":"ede8fa35-a392-4d60-b43a-95f575ff732a","Type":"ContainerStarted","Data":"f3f4ae625c8e7b5fa9644f9daa11c04a82fcb219d0e7195713c5589b4656498c"} Jul 09 14:45:09.211452 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.211396 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-479bn" podStartSLOduration=3.158188543 podStartE2EDuration="4.211377674s" totalImagesPullingTime="966.676942ms" totalInitContainerRuntime="86.512189ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:09.210651399 +0000 UTC m=+300.522062011" watchObservedRunningTime="2026-07-09 14:45:09.211377674 +0000 UTC m=+300.522788285" Jul 09 14:45:09.296659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:09.296559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:10.103174 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.103146 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dcf7c4dcd-tcfv7" Jul 09 14:45:10.197359 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.197325 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846" exitCode=0 Jul 09 14:45:10.197521 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.197411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846"} Jul 09 14:45:10.271160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.271126 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:10.327391 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.327359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:10.605599 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:10.605513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:11.182840 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:11.182806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:12.072909 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:12.072878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:12.208294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:12.208269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0"} Jul 09 14:45:12.208586 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:12.208354 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff"} Jul 09 14:45:12.305084 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:12.305064 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:45:13.214759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:13.214697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d"} Jul 09 14:45:13.215236 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:13.214799 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b"} Jul 09 14:45:13.215236 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:13.214849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81"} Jul 09 14:45:13.215236 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:13.214891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerStarted","Data":"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606"} Jul 09 14:45:13.248274 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:13.248218 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.221292295 podStartE2EDuration="7.24819765s" totalImagesPullingTime="4.009412599s" totalInitContainerRuntime="17.492756ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:13.247133401 +0000 UTC m=+304.558544014" watchObservedRunningTime="2026-07-09 14:45:13.24819765 +0000 UTC m=+304.559608261" Jul 09 14:45:14.294944 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:14.294912 2572 scope.go:117] "RemoveContainer" containerID="39d02bb25df5fb89b0d3883497dd713e1568f5dffdc6293f6e3925f8f9db05d2" Jul 09 14:45:15.224314 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.224287 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:45:15.224457 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.224392 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sb2rz" event={"ID":"79bec70a-ed65-40a4-871d-186bac01bb73","Type":"ContainerStarted","Data":"4bd6b358217b333f00071c1263e32eef382a5e624c55ec3606c02959981662f3"} Jul 09 14:45:15.224691 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.224671 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:45:15.244687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.244635 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-sb2rz" podStartSLOduration=55.167204979 podStartE2EDuration="58.244617596s" totalImagesPullingTime="3.077412617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:15.242196351 +0000 UTC m=+306.553606989" watchObservedRunningTime="2026-07-09 14:45:15.244617596 +0000 UTC m=+306.556028206" Jul 09 14:45:15.261251 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.261223 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-sb2rz" Jul 09 14:45:15.433626 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.433592 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-xj4qg"] Jul 09 14:45:15.436088 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.436069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:15.439009 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.438986 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:45:15.439109 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.439016 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:45:15.439109 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.439072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z99zm\"" Jul 09 14:45:15.449009 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.448976 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xj4qg"] Jul 09 14:45:15.455062 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.455037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:15.512233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.512143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgfb\" (UniqueName: \"kubernetes.io/projected/a5d9a1cc-6d30-433b-b079-8f1818232ec5-kube-api-access-8hgfb\") pod \"downloads-68c9cbb497-xj4qg\" (UID: \"a5d9a1cc-6d30-433b-b079-8f1818232ec5\") " pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:15.526782 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.526745 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:15.603923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.603883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:15.613025 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.612993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgfb\" (UniqueName: \"kubernetes.io/projected/a5d9a1cc-6d30-433b-b079-8f1818232ec5-kube-api-access-8hgfb\") pod \"downloads-68c9cbb497-xj4qg\" (UID: \"a5d9a1cc-6d30-433b-b079-8f1818232ec5\") " pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:15.622599 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.622570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgfb\" (UniqueName: \"kubernetes.io/projected/a5d9a1cc-6d30-433b-b079-8f1818232ec5-kube-api-access-8hgfb\") pod \"downloads-68c9cbb497-xj4qg\" (UID: \"a5d9a1cc-6d30-433b-b079-8f1818232ec5\") " pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:15.729283 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.729246 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:15.746929 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.746902 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:15.897172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:15.897151 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xj4qg"] Jul 09 14:45:15.899289 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:45:15.899260 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d9a1cc_6d30_433b_b079_8f1818232ec5.slice/crio-aab0ee3167cbbe859a74cb56f0987c61b0783eb152281f3bd3909176d96d4ffc WatchSource:0}: Error finding container aab0ee3167cbbe859a74cb56f0987c61b0783eb152281f3bd3909176d96d4ffc: Status 404 returned error can't find the container with id aab0ee3167cbbe859a74cb56f0987c61b0783eb152281f3bd3909176d96d4ffc Jul 09 14:45:16.182421 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.182336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:16.228970 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.228937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xj4qg" event={"ID":"a5d9a1cc-6d30-433b-b079-8f1818232ec5","Type":"ContainerStarted","Data":"aab0ee3167cbbe859a74cb56f0987c61b0783eb152281f3bd3909176d96d4ffc"} Jul 09 14:45:16.282479 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.282440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:16.524320 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.524260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:16.581470 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.581433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:16.813481 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:16.813392 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:17.294880 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:17.294844 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:45:17.420253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:17.420213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:17.534791 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:17.534705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:17.849319 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:17.849266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:18.262447 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:18.262367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:18.681619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:18.681556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:18.783502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:18.783464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:19.148383 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:19.148338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:19.207336 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:19.207301 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:20.112883 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:20.112844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:20.270486 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:20.270448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:27.065851 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.065805 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:45:27.079059 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.079023 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:45:27.079244 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.079127 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.082489 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.082410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:45:27.082489 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.082410 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:45:27.082710 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.082410 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:45:27.082710 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.082410 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:45:27.084202 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.084182 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bs7m9\"" Jul 09 14:45:27.084413 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.084394 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.229638 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.229687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.229759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.229814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrndw\" (UniqueName: \"kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.229942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.230472 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.230014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.330849 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331018 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.330959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrndw\" (UniqueName: \"kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331548 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.331520 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.331641 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.331816 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.331638 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.333898 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.333878 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.334024 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.333997 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.340086 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.340018 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrndw\" (UniqueName: \"kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw\") pod \"console-58775ffc7c-bz2z8\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.392010 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.391972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:27.756644 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.756500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:27.858749 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:27.858662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:31.007713 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:31.007661 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:31.107815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:31.107768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:32.156439 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.156410 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:45:32.158951 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:45:32.158927 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde368362_09c3_4115_b333_29dde51b078a.slice/crio-fbfd3594a21683a1195deb116f60ab7fe33e0e892ae48f3aff0f593355b289cd WatchSource:0}: Error finding container fbfd3594a21683a1195deb116f60ab7fe33e0e892ae48f3aff0f593355b289cd: Status 404 returned error can't find the container with id fbfd3594a21683a1195deb116f60ab7fe33e0e892ae48f3aff0f593355b289cd Jul 09 14:45:32.296374 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.296334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58775ffc7c-bz2z8" event={"ID":"de368362-09c3-4115-b333-29dde51b078a","Type":"ContainerStarted","Data":"fbfd3594a21683a1195deb116f60ab7fe33e0e892ae48f3aff0f593355b289cd"} Jul 09 14:45:32.298115 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.298074 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xj4qg" event={"ID":"a5d9a1cc-6d30-433b-b079-8f1818232ec5","Type":"ContainerStarted","Data":"fdd9f7c6b374f785c7b0e459fe73ab4b82b6e6a237973fbf7b37fa15ab6401af"} Jul 09 14:45:32.298365 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.298341 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:32.299622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.299597 2572 patch_prober.go:28] interesting pod/downloads-68c9cbb497-xj4qg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" start-of-body= Jul 09 14:45:32.299710 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.299646 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-xj4qg" podUID="a5d9a1cc-6d30-433b-b079-8f1818232ec5" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" Jul 09 14:45:32.316357 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.316309 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-xj4qg" podStartSLOduration=1.119002303 podStartE2EDuration="17.316291222s" totalImagesPullingTime="16.197288919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:32.315435371 +0000 UTC m=+323.626845983" watchObservedRunningTime="2026-07-09 14:45:32.316291222 +0000 UTC m=+323.627701844" Jul 09 14:45:32.541772 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.541735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:32.598987 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:32.598855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:33.321712 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:33.321677 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-xj4qg" Jul 09 14:45:36.320875 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.320835 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58775ffc7c-bz2z8" event={"ID":"de368362-09c3-4115-b333-29dde51b078a","Type":"ContainerStarted","Data":"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e"} Jul 09 14:45:36.341496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.341461 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:45:36.342918 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.342870 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58775ffc7c-bz2z8" podStartSLOduration=5.49182067 podStartE2EDuration="9.342850334s" totalImagesPullingTime="3.851029664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:36.339631766 +0000 UTC m=+327.651042388" watchObservedRunningTime="2026-07-09 14:45:36.342850334 +0000 UTC m=+327.654260946" Jul 09 14:45:36.359536 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.359492 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:45:36.359688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.359631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.376109 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.376080 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:45:36.523464 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523430 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523622 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523799 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523799 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523713 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kd45\" (UniqueName: \"kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.523799 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.523781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.624855 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624766 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.624855 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kd45\" (UniqueName: \"kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.624855 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624853 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.624994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.625019 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625737 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.625691 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.625856 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.625790 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.626114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.626088 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.626218 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.626198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.628669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.628230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.629426 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.629399 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.639207 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.639183 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kd45\" (UniqueName: \"kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45\") pod \"console-5889f5cb8c-gwsvp\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.673223 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.673188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:36.865157 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.865121 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:36.869594 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.869500 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:45:36.871870 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:45:36.871845 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef74aca_f8a0_4b96_b811_74669ae47ea5.slice/crio-7bcb27c5b925369e7c2b23c6629b00b3fab96d3b8491edc2c8816ebad3cd2bd6 WatchSource:0}: Error finding container 7bcb27c5b925369e7c2b23c6629b00b3fab96d3b8491edc2c8816ebad3cd2bd6: Status 404 returned error can't find the container with id 7bcb27c5b925369e7c2b23c6629b00b3fab96d3b8491edc2c8816ebad3cd2bd6 Jul 09 14:45:36.961773 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:36.961742 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:37.327806 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.327761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889f5cb8c-gwsvp" event={"ID":"cef74aca-f8a0-4b96-b811-74669ae47ea5","Type":"ContainerStarted","Data":"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1"} Jul 09 14:45:37.328292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.327827 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889f5cb8c-gwsvp" event={"ID":"cef74aca-f8a0-4b96-b811-74669ae47ea5","Type":"ContainerStarted","Data":"7bcb27c5b925369e7c2b23c6629b00b3fab96d3b8491edc2c8816ebad3cd2bd6"} Jul 09 14:45:37.354270 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.354209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5889f5cb8c-gwsvp" podStartSLOduration=1.3541903880000001 podStartE2EDuration="1.354190388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:45:37.352797972 +0000 UTC m=+328.664208584" watchObservedRunningTime="2026-07-09 14:45:37.354190388 +0000 UTC m=+328.665600998" Jul 09 14:45:37.392507 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.392465 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:37.392676 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.392533 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:37.398429 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.398402 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:37.883336 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:37.883300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:38.043068 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:38.043039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:38.161250 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:38.161167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:38.337860 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:38.337831 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:45:43.746185 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:43.746137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:43.800871 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:43.800832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:45.998421 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:45.998386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:46.105709 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:46.105671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:46.673409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:46.673375 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:46.673578 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:46.673428 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:46.678278 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:46.678258 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:47.371629 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:47.371598 2572 generic.go:356] "Generic (PLEG): container finished" podID="8362d60d-f199-41c4-9389-40f49eca7d1c" containerID="dbc07b951371f4fa63b3e8b6497cddcf364c105fe7931ad1d922b9a81b0293ca" exitCode=0 Jul 09 14:45:47.372024 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:47.371670 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" event={"ID":"8362d60d-f199-41c4-9389-40f49eca7d1c","Type":"ContainerDied","Data":"dbc07b951371f4fa63b3e8b6497cddcf364c105fe7931ad1d922b9a81b0293ca"} Jul 09 14:45:47.372173 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:47.372157 2572 scope.go:117] "RemoveContainer" containerID="dbc07b951371f4fa63b3e8b6497cddcf364c105fe7931ad1d922b9a81b0293ca" Jul 09 14:45:47.375849 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:47.375827 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:45:47.435518 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:47.435489 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:45:48.376912 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:48.376880 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qxj4" event={"ID":"8362d60d-f199-41c4-9389-40f49eca7d1c","Type":"ContainerStarted","Data":"d6e2ea34b1c3a00c77649c3e8f5bb133b048f44fd7b019390d8b3bb28fc595b3"} Jul 09 14:45:59.771831 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:59.771743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:45:59.872568 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:45:59.872535 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:12.456993 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.456927 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58775ffc7c-bz2z8" podUID="de368362-09c3-4115-b333-29dde51b078a" containerName="console" containerID="cri-o://4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e" gracePeriod=15 Jul 09 14:46:12.733246 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.733174 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:46:12.835456 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835417 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.835456 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835458 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.835701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835498 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.835701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835573 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.835701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835598 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrndw\" (UniqueName: \"kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.835701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835616 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config\") pod \"de368362-09c3-4115-b333-29dde51b078a\" (UID: \"de368362-09c3-4115-b333-29dde51b078a\") " Jul 09 14:46:12.836035 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835897 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:12.836168 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.835906 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca" (OuterVolumeSpecName: "service-ca") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:12.836168 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.836094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config" (OuterVolumeSpecName: "console-config") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:12.838079 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.838047 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:12.838179 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.838112 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:12.838179 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.838121 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw" (OuterVolumeSpecName: "kube-api-access-xrndw") pod "de368362-09c3-4115-b333-29dde51b078a" (UID: "de368362-09c3-4115-b333-29dde51b078a"). InnerVolumeSpecName "kube-api-access-xrndw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:46:12.936747 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936689 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:12.936915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936757 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrndw\" (UniqueName: \"kubernetes.io/projected/de368362-09c3-4115-b333-29dde51b078a-kube-api-access-xrndw\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:12.936915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936770 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-console-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:12.936915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936778 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-oauth-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:12.936915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936787 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de368362-09c3-4115-b333-29dde51b078a-service-ca\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:12.936915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:12.936795 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de368362-09c3-4115-b333-29dde51b078a-console-oauth-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:13.475306 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.475273 2572 generic.go:356] "Generic (PLEG): container finished" podID="de368362-09c3-4115-b333-29dde51b078a" containerID="4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e" exitCode=0 Jul 09 14:46:13.475689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.475325 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58775ffc7c-bz2z8" Jul 09 14:46:13.475689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.475328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58775ffc7c-bz2z8" event={"ID":"de368362-09c3-4115-b333-29dde51b078a","Type":"ContainerDied","Data":"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e"} Jul 09 14:46:13.475689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.475369 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58775ffc7c-bz2z8" event={"ID":"de368362-09c3-4115-b333-29dde51b078a","Type":"ContainerDied","Data":"fbfd3594a21683a1195deb116f60ab7fe33e0e892ae48f3aff0f593355b289cd"} Jul 09 14:46:13.475689 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.475388 2572 scope.go:117] "RemoveContainer" containerID="4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e" Jul 09 14:46:13.483551 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.483533 2572 scope.go:117] "RemoveContainer" containerID="4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e" Jul 09 14:46:13.483840 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:13.483821 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e\": container with ID starting with 4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e not found: ID does not exist" containerID="4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e" Jul 09 14:46:13.483896 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.483848 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e"} err="failed to get container status \"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e\": rpc error: code = NotFound desc = could not find container \"4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e\": container with ID starting with 4679f80c6ad657eaea47a65ae7b13d1faeda92543c62dad461cdac202b62ea4e not found: ID does not exist" Jul 09 14:46:13.492640 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.492618 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:46:13.496480 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:13.496461 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58775ffc7c-bz2z8"] Jul 09 14:46:15.299489 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:15.299457 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de368362-09c3-4115-b333-29dde51b078a" path="/var/lib/kubelet/pods/de368362-09c3-4115-b333-29dde51b078a/volumes" Jul 09 14:46:15.838631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:15.838598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:15.894265 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:15.894226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:15.949772 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:15.949714 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:16.179013 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:16.178918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:16.232053 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:16.232021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:21.932001 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:21.931948 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:21.991962 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:21.991932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:23.122707 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.122669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:46:23.125056 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.125037 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ccf631e-01f6-4635-8f46-5a410f14643c-metrics-certs\") pod \"network-metrics-daemon-2wzc2\" (UID: \"2ccf631e-01f6-4635-8f46-5a410f14643c\") " pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:46:23.298641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.298615 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d62s8\"" Jul 09 14:46:23.305572 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.305547 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wzc2" Jul 09 14:46:23.436300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.436275 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wzc2"] Jul 09 14:46:23.438919 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:46:23.438888 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccf631e_01f6_4635_8f46_5a410f14643c.slice/crio-484253eb887cd10e806665add0548b8f3dd4e60be0f3e26339ff636e7461a414 WatchSource:0}: Error finding container 484253eb887cd10e806665add0548b8f3dd4e60be0f3e26339ff636e7461a414: Status 404 returned error can't find the container with id 484253eb887cd10e806665add0548b8f3dd4e60be0f3e26339ff636e7461a414 Jul 09 14:46:23.512029 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:23.511993 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wzc2" event={"ID":"2ccf631e-01f6-4635-8f46-5a410f14643c","Type":"ContainerStarted","Data":"484253eb887cd10e806665add0548b8f3dd4e60be0f3e26339ff636e7461a414"} Jul 09 14:46:24.518974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:24.518942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wzc2" event={"ID":"2ccf631e-01f6-4635-8f46-5a410f14643c","Type":"ContainerStarted","Data":"7ff87bf7ebb13c798ec5364ad666253d4c17414d67714cde7136e1e5342eec3f"} Jul 09 14:46:25.524651 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:25.524617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wzc2" event={"ID":"2ccf631e-01f6-4635-8f46-5a410f14643c","Type":"ContainerStarted","Data":"7505c8811f7e594b89ab95d35d44691135094a8eae3b10c5cf1814cb2f7049de"} Jul 09 14:46:25.548124 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:25.548069 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2wzc2" podStartSLOduration=375.575835783 podStartE2EDuration="6m16.548052366s" totalImagesPullingTime="972.216583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:46:25.545748775 +0000 UTC m=+376.857159386" watchObservedRunningTime="2026-07-09 14:46:25.548052366 +0000 UTC m=+376.859462977" Jul 09 14:46:25.679245 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:25.679208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:25.767239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:25.767203 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:26.240977 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.240943 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:26.241339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241311 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="alertmanager" containerID="cri-o://ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" gracePeriod=120 Jul 09 14:46:26.241446 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241377 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-metric" containerID="cri-o://db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" gracePeriod=120 Jul 09 14:46:26.241446 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241404 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="prom-label-proxy" containerID="cri-o://aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" gracePeriod=120 Jul 09 14:46:26.241446 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241423 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-web" containerID="cri-o://fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" gracePeriod=120 Jul 09 14:46:26.241596 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241461 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="config-reloader" containerID="cri-o://19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" gracePeriod=120 Jul 09 14:46:26.241596 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.241489 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy" containerID="cri-o://b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" gracePeriod=120 Jul 09 14:46:26.532354 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532321 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" exitCode=0 Jul 09 14:46:26.532354 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532347 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" exitCode=0 Jul 09 14:46:26.532354 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532354 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" exitCode=0 Jul 09 14:46:26.532354 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532360 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" exitCode=0 Jul 09 14:46:26.532815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b"} Jul 09 14:46:26.532815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532467 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606"} Jul 09 14:46:26.532815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532507 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0"} Jul 09 14:46:26.532815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:26.532549 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff"} Jul 09 14:46:27.499440 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.499414 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.541918 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.541881 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" exitCode=0 Jul 09 14:46:27.541918 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.541917 2572 generic.go:356] "Generic (PLEG): container finished" podID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerID="fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" exitCode=0 Jul 09 14:46:27.542410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.541971 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.542410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.541969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81"} Jul 09 14:46:27.542410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.542073 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d"} Jul 09 14:46:27.542410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.542121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5947d57c-993a-4311-9a09-73bec5ed91f5","Type":"ContainerDied","Data":"fc3a73272f90a3eeff89f5b259384fd0d064ed6f95e21b6b3be97386b71e3e21"} Jul 09 14:46:27.542410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.542163 2572 scope.go:117] "RemoveContainer" containerID="aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" Jul 09 14:46:27.551498 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.551481 2572 scope.go:117] "RemoveContainer" containerID="db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" Jul 09 14:46:27.558930 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.558911 2572 scope.go:117] "RemoveContainer" containerID="b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" Jul 09 14:46:27.563124 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563102 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563140 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563184 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563239 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563217 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lrmn\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563401 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563263 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563401 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563296 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563401 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563323 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563401 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563352 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563401 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563381 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563407 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563437 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563479 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563505 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") pod \"5947d57c-993a-4311-9a09-73bec5ed91f5\" (UID: \"5947d57c-993a-4311-9a09-73bec5ed91f5\") " Jul 09 14:46:27.563659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563570 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:27.563923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563810 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-metrics-client-ca\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.564612 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.563977 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:46:27.565525 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.565489 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:46:27.566982 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.566926 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume" (OuterVolumeSpecName: "config-volume") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.567294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.567248 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.567696 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.567668 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.568119 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.568094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:46:27.568603 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.568579 2572 scope.go:117] "RemoveContainer" containerID="fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" Jul 09 14:46:27.568833 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.568793 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.569084 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.569060 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn" (OuterVolumeSpecName: "kube-api-access-5lrmn") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "kube-api-access-5lrmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:46:27.569575 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.569517 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.569688 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.569637 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out" (OuterVolumeSpecName: "config-out") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:46:27.573352 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.573320 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.580233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.580205 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config" (OuterVolumeSpecName: "web-config") pod "5947d57c-993a-4311-9a09-73bec5ed91f5" (UID: "5947d57c-993a-4311-9a09-73bec5ed91f5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:46:27.580447 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.580428 2572 scope.go:117] "RemoveContainer" containerID="19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" Jul 09 14:46:27.588366 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.588346 2572 scope.go:117] "RemoveContainer" containerID="ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" Jul 09 14:46:27.595663 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.595640 2572 scope.go:117] "RemoveContainer" containerID="a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846" Jul 09 14:46:27.603162 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603144 2572 scope.go:117] "RemoveContainer" containerID="aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" Jul 09 14:46:27.603432 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.603413 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b\": container with ID starting with aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b not found: ID does not exist" containerID="aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" Jul 09 14:46:27.603494 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603441 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b"} err="failed to get container status \"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b\": rpc error: code = NotFound desc = could not find container \"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b\": container with ID starting with aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b not found: ID does not exist" Jul 09 14:46:27.603494 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603460 2572 scope.go:117] "RemoveContainer" containerID="db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" Jul 09 14:46:27.603690 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.603675 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81\": container with ID starting with db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81 not found: ID does not exist" containerID="db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" Jul 09 14:46:27.603765 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603695 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81"} err="failed to get container status \"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81\": rpc error: code = NotFound desc = could not find container \"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81\": container with ID starting with db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81 not found: ID does not exist" Jul 09 14:46:27.603765 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603710 2572 scope.go:117] "RemoveContainer" containerID="b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" Jul 09 14:46:27.603947 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.603929 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606\": container with ID starting with b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606 not found: ID does not exist" containerID="b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" Jul 09 14:46:27.603988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603956 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606"} err="failed to get container status \"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606\": rpc error: code = NotFound desc = could not find container \"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606\": container with ID starting with b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606 not found: ID does not exist" Jul 09 14:46:27.603988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.603971 2572 scope.go:117] "RemoveContainer" containerID="fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" Jul 09 14:46:27.604211 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.604167 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d\": container with ID starting with fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d not found: ID does not exist" containerID="fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" Jul 09 14:46:27.604296 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604215 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d"} err="failed to get container status \"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d\": rpc error: code = NotFound desc = could not find container \"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d\": container with ID starting with fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d not found: ID does not exist" Jul 09 14:46:27.604296 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604230 2572 scope.go:117] "RemoveContainer" containerID="19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" Jul 09 14:46:27.604440 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.604424 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0\": container with ID starting with 19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0 not found: ID does not exist" containerID="19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" Jul 09 14:46:27.604486 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604443 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0"} err="failed to get container status \"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0\": rpc error: code = NotFound desc = could not find container \"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0\": container with ID starting with 19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0 not found: ID does not exist" Jul 09 14:46:27.604486 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604455 2572 scope.go:117] "RemoveContainer" containerID="ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" Jul 09 14:46:27.604672 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.604658 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff\": container with ID starting with ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff not found: ID does not exist" containerID="ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" Jul 09 14:46:27.604708 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604675 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff"} err="failed to get container status \"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff\": rpc error: code = NotFound desc = could not find container \"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff\": container with ID starting with ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff not found: ID does not exist" Jul 09 14:46:27.604708 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604688 2572 scope.go:117] "RemoveContainer" containerID="a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846" Jul 09 14:46:27.604918 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:46:27.604902 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846\": container with ID starting with a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846 not found: ID does not exist" containerID="a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846" Jul 09 14:46:27.604959 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604922 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846"} err="failed to get container status \"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846\": rpc error: code = NotFound desc = could not find container \"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846\": container with ID starting with a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846 not found: ID does not exist" Jul 09 14:46:27.604959 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.604936 2572 scope.go:117] "RemoveContainer" containerID="aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b" Jul 09 14:46:27.605142 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605122 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b"} err="failed to get container status \"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b\": rpc error: code = NotFound desc = could not find container \"aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b\": container with ID starting with aff418f4746ac798266c6905a0c00f3cbc6347d36d8e9c58bc2e16e6929c3d7b not found: ID does not exist" Jul 09 14:46:27.605181 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605144 2572 scope.go:117] "RemoveContainer" containerID="db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81" Jul 09 14:46:27.605373 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605352 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81"} err="failed to get container status \"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81\": rpc error: code = NotFound desc = could not find container \"db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81\": container with ID starting with db31734abb8e715784a6ebbddfef95d4e6bc800083a57dde2127693636e5bc81 not found: ID does not exist" Jul 09 14:46:27.605417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605374 2572 scope.go:117] "RemoveContainer" containerID="b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606" Jul 09 14:46:27.605580 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605563 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606"} err="failed to get container status \"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606\": rpc error: code = NotFound desc = could not find container \"b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606\": container with ID starting with b1412a60547cd37637efdae27119ca5ed611cd325d9a4da215c487af38f2e606 not found: ID does not exist" Jul 09 14:46:27.605621 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605583 2572 scope.go:117] "RemoveContainer" containerID="fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d" Jul 09 14:46:27.605851 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605826 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d"} err="failed to get container status \"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d\": rpc error: code = NotFound desc = could not find container \"fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d\": container with ID starting with fa1a36a4ede6e2c2a21edd90108fb460b7f97c37f5c03fe285e3532e0f1a532d not found: ID does not exist" Jul 09 14:46:27.605901 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.605852 2572 scope.go:117] "RemoveContainer" containerID="19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0" Jul 09 14:46:27.606083 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.606067 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0"} err="failed to get container status \"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0\": rpc error: code = NotFound desc = could not find container \"19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0\": container with ID starting with 19fdc4b413fd22bcf758086fd87c692849d88bef95b6b7e9aa3a147a52614bc0 not found: ID does not exist" Jul 09 14:46:27.606083 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.606082 2572 scope.go:117] "RemoveContainer" containerID="ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff" Jul 09 14:46:27.606287 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.606271 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff"} err="failed to get container status \"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff\": rpc error: code = NotFound desc = could not find container \"ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff\": container with ID starting with ab9f6574ee15f0bc88b61d9fddebb368ad0bb98890e47bb6415c8bcb68ed53ff not found: ID does not exist" Jul 09 14:46:27.606327 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.606289 2572 scope.go:117] "RemoveContainer" containerID="a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846" Jul 09 14:46:27.606514 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.606499 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846"} err="failed to get container status \"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846\": rpc error: code = NotFound desc = could not find container \"a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846\": container with ID starting with a6de82ca992362e7b99fc238244b9a06a7cc8ba9bf7aba21684ab5509dc67846 not found: ID does not exist" Jul 09 14:46:27.665038 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.664999 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665038 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665030 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665038 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665042 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-main-tls\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665051 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-tls-assets\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665060 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665069 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lrmn\" (UniqueName: \"kubernetes.io/projected/5947d57c-993a-4311-9a09-73bec5ed91f5-kube-api-access-5lrmn\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665077 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-alertmanager-main-db\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665085 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-cluster-tls-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665093 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5947d57c-993a-4311-9a09-73bec5ed91f5-config-out\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665100 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-config-volume\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665108 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.665253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.665116 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5947d57c-993a-4311-9a09-73bec5ed91f5-web-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:46:27.868284 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.868254 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:27.871795 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.871757 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:27.899593 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899566 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:27.899884 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899872 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="init-config-reloader" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899886 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="init-config-reloader" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899897 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899902 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899909 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de368362-09c3-4115-b333-29dde51b078a" containerName="console" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899915 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="de368362-09c3-4115-b333-29dde51b078a" containerName="console" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899923 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-metric" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899928 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-metric" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899937 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="prom-label-proxy" Jul 09 14:46:27.899942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899942 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="prom-label-proxy" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899952 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="alertmanager" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899957 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="alertmanager" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899965 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="config-reloader" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899971 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="config-reloader" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899976 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-web" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.899981 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-web" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900020 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-web" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900027 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy-metric" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900031 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="prom-label-proxy" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900036 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="de368362-09c3-4115-b333-29dde51b078a" containerName="console" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900042 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="config-reloader" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900048 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="kube-rbac-proxy" Jul 09 14:46:27.900189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.900053 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" containerName="alertmanager" Jul 09 14:46:27.903477 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.903459 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.906372 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906352 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:46:27.906509 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906487 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:46:27.906582 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906530 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:46:27.906582 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906498 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6m9p6\"" Jul 09 14:46:27.906698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906580 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:46:27.906698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906619 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:46:27.906698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906636 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:46:27.906698 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906692 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:46:27.906883 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.906782 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:46:27.912443 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.912422 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:46:27.921477 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.921453 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:27.966924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.966885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.966924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.966926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.966947 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.966965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967007 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-config-out\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967037 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-web-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967145 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967169 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:27.967381 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:27.967272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg4tb\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-kube-api-access-pg4tb\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068001 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.067966 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068001 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068004 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-config-out\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-web-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068177 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068225 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg4tb\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-kube-api-access-pg4tb\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068449 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.068802 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.068494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.069661 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.069618 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071078 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e656a72-e8f7-425d-816b-0bdb85958df5-config-out\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071164 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071209 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-web-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071335 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-config-volume\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071736 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e656a72-e8f7-425d-816b-0bdb85958df5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.071823 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.071801 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.072276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.072258 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.073174 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.073157 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8e656a72-e8f7-425d-816b-0bdb85958df5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.079460 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.079441 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg4tb\" (UniqueName: \"kubernetes.io/projected/8e656a72-e8f7-425d-816b-0bdb85958df5-kube-api-access-pg4tb\") pod \"alertmanager-main-0\" (UID: \"8e656a72-e8f7-425d-816b-0bdb85958df5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.214108 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.214011 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:46:28.352493 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.352307 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:46:28.354313 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:46:28.354275 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e656a72_e8f7_425d_816b_0bdb85958df5.slice/crio-50705a1ba879790ae60fe7f4bd35dbf86943ae17116e39ac19d8cc8304ae6deb WatchSource:0}: Error finding container 50705a1ba879790ae60fe7f4bd35dbf86943ae17116e39ac19d8cc8304ae6deb: Status 404 returned error can't find the container with id 50705a1ba879790ae60fe7f4bd35dbf86943ae17116e39ac19d8cc8304ae6deb Jul 09 14:46:28.547633 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.547597 2572 generic.go:356] "Generic (PLEG): container finished" podID="8e656a72-e8f7-425d-816b-0bdb85958df5" containerID="cf4cb3b1d7a2cfeb2c6a6bdd7ef8f033b5fed7e0642ca014a8c2d4e63efe030b" exitCode=0 Jul 09 14:46:28.548098 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.547684 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerDied","Data":"cf4cb3b1d7a2cfeb2c6a6bdd7ef8f033b5fed7e0642ca014a8c2d4e63efe030b"} Jul 09 14:46:28.548098 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:28.547786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"50705a1ba879790ae60fe7f4bd35dbf86943ae17116e39ac19d8cc8304ae6deb"} Jul 09 14:46:29.299377 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.299341 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5947d57c-993a-4311-9a09-73bec5ed91f5" path="/var/lib/kubelet/pods/5947d57c-993a-4311-9a09-73bec5ed91f5/volumes" Jul 09 14:46:29.555989 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.555902 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"ef1a83a329de2bfda298f7fa04d76a9b9065eb660cf742593516d722b7aff9ab"} Jul 09 14:46:29.555989 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.555968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"c706e01733130384b6191abb43238dc77f570159a065195f74bf367b97eedabf"} Jul 09 14:46:29.556400 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.555996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"10e374afb4dd54650cf6d832aa0cc55cf2b7b80a6639546d2008c6328a78d5dd"} Jul 09 14:46:29.556400 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.556021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"7707d22f9e44b23f7e7a0e3deb824a5b84de6181bdcfdd3b8a477abbd55edff6"} Jul 09 14:46:29.556400 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.556044 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"d1a0ac8fbec29e85fab842436cbc8b5dc22c37b4e51548da5eb0b6e2945ebd44"} Jul 09 14:46:29.556400 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.556067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8e656a72-e8f7-425d-816b-0bdb85958df5","Type":"ContainerStarted","Data":"73fff631cada12f322fd0676c79a2c8c7f346e8cbeb8316ed3c05a4de5b3d00c"} Jul 09 14:46:29.587577 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:29.587518 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.572291978 podStartE2EDuration="2.587501669s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.209691ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:46:29.585521975 +0000 UTC m=+380.896932587" watchObservedRunningTime="2026-07-09 14:46:29.587501669 +0000 UTC m=+380.898912280" Jul 09 14:46:33.726845 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:33.726813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:33.778363 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:33.778323 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.013822 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.013786 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:46:37.016873 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.016849 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.029516 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.029493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:46:37.036057 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036026 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036209 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9w5q\" (UniqueName: \"kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036209 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036330 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036330 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036424 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.036424 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.036376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.071084 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.071042 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.127930 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.127888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.137489 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137566 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9w5q\" (UniqueName: \"kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137861 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.137861 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.137689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.138407 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.138381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.138590 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.138569 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.138669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.138626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.138669 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.138652 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.140189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.140161 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.140273 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.140191 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.148153 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.148129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9w5q\" (UniqueName: \"kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q\") pod \"console-787b54c475-vxg2r\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.216308 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.216267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.318244 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.318209 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.327082 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.327057 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:37.468615 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.468591 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:46:37.471059 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:46:37.471036 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b754df7_100e_47ed_b9e4_e610bd906335.slice/crio-7c09432b846a2ba80914604b141d18c08007da6ede4278eb37e0f6a1b520fc6d WatchSource:0}: Error finding container 7c09432b846a2ba80914604b141d18c08007da6ede4278eb37e0f6a1b520fc6d: Status 404 returned error can't find the container with id 7c09432b846a2ba80914604b141d18c08007da6ede4278eb37e0f6a1b520fc6d Jul 09 14:46:37.591630 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.591545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787b54c475-vxg2r" event={"ID":"3b754df7-100e-47ed-b9e4-e610bd906335","Type":"ContainerStarted","Data":"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32"} Jul 09 14:46:37.591630 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.591594 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787b54c475-vxg2r" event={"ID":"3b754df7-100e-47ed-b9e4-e610bd906335","Type":"ContainerStarted","Data":"7c09432b846a2ba80914604b141d18c08007da6ede4278eb37e0f6a1b520fc6d"} Jul 09 14:46:37.611112 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.611062 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787b54c475-vxg2r" podStartSLOduration=1.611022376 podStartE2EDuration="1.611022376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:46:37.609490097 +0000 UTC m=+388.920900706" watchObservedRunningTime="2026-07-09 14:46:37.611022376 +0000 UTC m=+388.922432989" Jul 09 14:46:37.808022 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.807981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:37.866648 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:37.866559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:46.010365 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:46.010328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:46.112184 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:46.112147 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:47.327280 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.327248 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:47.327666 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.327302 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:47.332238 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.332216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:47.633221 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.633137 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:46:47.679430 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.679395 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:46:47.817384 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.817344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:47.919615 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.919529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:46:47.981217 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:46:47.981185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:12.701261 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:12.701196 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5889f5cb8c-gwsvp" podUID="cef74aca-f8a0-4b96-b811-74669ae47ea5" containerName="console" containerID="cri-o://9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1" gracePeriod=15 Jul 09 14:47:12.956232 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:12.956173 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:47:13.036785 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036747 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036808 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036835 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kd45\" (UniqueName: \"kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036893 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036910 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036933 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.036976 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.036956 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle\") pod \"cef74aca-f8a0-4b96-b811-74669ae47ea5\" (UID: \"cef74aca-f8a0-4b96-b811-74669ae47ea5\") " Jul 09 14:47:13.037277 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.037169 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca" (OuterVolumeSpecName: "service-ca") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:47:13.037459 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.037420 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config" (OuterVolumeSpecName: "console-config") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:47:13.037459 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.037446 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:47:13.037790 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.037497 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:47:13.039240 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.039214 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:47:13.039349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.039304 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:47:13.039349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.039325 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45" (OuterVolumeSpecName: "kube-api-access-4kd45") pod "cef74aca-f8a0-4b96-b811-74669ae47ea5" (UID: "cef74aca-f8a0-4b96-b811-74669ae47ea5"). InnerVolumeSpecName "kube-api-access-4kd45". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:47:13.137548 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137513 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-oauth-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137548 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137540 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-oauth-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137548 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137550 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137807 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137560 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-trusted-ca-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137807 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137571 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cef74aca-f8a0-4b96-b811-74669ae47ea5-service-ca\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137807 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137579 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef74aca-f8a0-4b96-b811-74669ae47ea5-console-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.137807 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.137587 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kd45\" (UniqueName: \"kubernetes.io/projected/cef74aca-f8a0-4b96-b811-74669ae47ea5-kube-api-access-4kd45\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:13.729468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.729380 2572 generic.go:356] "Generic (PLEG): container finished" podID="cef74aca-f8a0-4b96-b811-74669ae47ea5" containerID="9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1" exitCode=0 Jul 09 14:47:13.729468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.729426 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889f5cb8c-gwsvp" Jul 09 14:47:13.729468 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.729434 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889f5cb8c-gwsvp" event={"ID":"cef74aca-f8a0-4b96-b811-74669ae47ea5","Type":"ContainerDied","Data":"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1"} Jul 09 14:47:13.729986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.729478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889f5cb8c-gwsvp" event={"ID":"cef74aca-f8a0-4b96-b811-74669ae47ea5","Type":"ContainerDied","Data":"7bcb27c5b925369e7c2b23c6629b00b3fab96d3b8491edc2c8816ebad3cd2bd6"} Jul 09 14:47:13.729986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.729500 2572 scope.go:117] "RemoveContainer" containerID="9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1" Jul 09 14:47:13.737767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.737750 2572 scope.go:117] "RemoveContainer" containerID="9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1" Jul 09 14:47:13.738013 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:47:13.737992 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1\": container with ID starting with 9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1 not found: ID does not exist" containerID="9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1" Jul 09 14:47:13.738072 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.738025 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1"} err="failed to get container status \"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1\": rpc error: code = NotFound desc = could not find container \"9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1\": container with ID starting with 9c6113e40abc8c0da41449b68128410dbedd9fb8f9c52db67b0e7a1d6cea6ad1 not found: ID does not exist" Jul 09 14:47:13.746986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.746967 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:47:13.750803 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:13.750784 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5889f5cb8c-gwsvp"] Jul 09 14:47:15.299867 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:15.299833 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef74aca-f8a0-4b96-b811-74669ae47ea5" path="/var/lib/kubelet/pods/cef74aca-f8a0-4b96-b811-74669ae47ea5/volumes" Jul 09 14:47:29.739972 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:29.739885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:29.825623 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:29.825573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:30.400936 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.400897 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r"] Jul 09 14:47:30.401256 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.401239 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef74aca-f8a0-4b96-b811-74669ae47ea5" containerName="console" Jul 09 14:47:30.401359 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.401260 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef74aca-f8a0-4b96-b811-74669ae47ea5" containerName="console" Jul 09 14:47:30.401417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.401359 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef74aca-f8a0-4b96-b811-74669ae47ea5" containerName="console" Jul 09 14:47:30.404495 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.404471 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.407443 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.407418 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:47:30.407563 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.407427 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:47:30.408955 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.408938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mfs42\"" Jul 09 14:47:30.414513 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.414488 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r"] Jul 09 14:47:30.571144 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.571105 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.571315 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.571165 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.571315 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.571225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65pl\" (UniqueName: \"kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.672092 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.671994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.672092 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.672057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65pl\" (UniqueName: \"kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.672271 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.672104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.672404 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.672386 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.672444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.672429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.682491 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.682460 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65pl\" (UniqueName: \"kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.714833 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.714804 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:30.850349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:30.850319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r"] Jul 09 14:47:30.854059 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:47:30.854029 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6869d579_ae16_44e0_8ae6_2fe5064ceb31.slice/crio-a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f WatchSource:0}: Error finding container a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f: Status 404 returned error can't find the container with id a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f Jul 09 14:47:31.799517 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:31.799478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" event={"ID":"6869d579-ae16-44e0-8ae6-2fe5064ceb31","Type":"ContainerStarted","Data":"a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f"} Jul 09 14:47:37.342905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:37.342835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:39.835447 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:39.835406 2572 generic.go:356] "Generic (PLEG): container finished" podID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerID="9a9023ac7ea1c8ad351b0715bb2ccb03a4cc7734241aae2ef2109352e6cf6f4a" exitCode=0 Jul 09 14:47:39.835905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:39.835493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" event={"ID":"6869d579-ae16-44e0-8ae6-2fe5064ceb31","Type":"ContainerDied","Data":"9a9023ac7ea1c8ad351b0715bb2ccb03a4cc7734241aae2ef2109352e6cf6f4a"} Jul 09 14:47:42.850362 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:42.850327 2572 generic.go:356] "Generic (PLEG): container finished" podID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerID="690ecc09d53c4c71db0596d7d7dfee4b07a494f81d921d6f3a1fb8150a100632" exitCode=0 Jul 09 14:47:42.850792 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:42.850375 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" event={"ID":"6869d579-ae16-44e0-8ae6-2fe5064ceb31","Type":"ContainerDied","Data":"690ecc09d53c4c71db0596d7d7dfee4b07a494f81d921d6f3a1fb8150a100632"} Jul 09 14:47:51.895939 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:51.895873 2572 generic.go:356] "Generic (PLEG): container finished" podID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerID="14dc48cf06f9f5762ce633c8fa5a13b7113996323996b1883ea1a801fd57ddea" exitCode=0 Jul 09 14:47:51.895939 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:51.895921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" event={"ID":"6869d579-ae16-44e0-8ae6-2fe5064ceb31","Type":"ContainerDied","Data":"14dc48cf06f9f5762ce633c8fa5a13b7113996323996b1883ea1a801fd57ddea"} Jul 09 14:47:53.046712 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.046684 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:53.149056 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.149017 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle\") pod \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " Jul 09 14:47:53.149234 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.149065 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util\") pod \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " Jul 09 14:47:53.149234 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.149124 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q65pl\" (UniqueName: \"kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl\") pod \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\" (UID: \"6869d579-ae16-44e0-8ae6-2fe5064ceb31\") " Jul 09 14:47:53.149704 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.149681 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle" (OuterVolumeSpecName: "bundle") pod "6869d579-ae16-44e0-8ae6-2fe5064ceb31" (UID: "6869d579-ae16-44e0-8ae6-2fe5064ceb31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:53.151552 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.151491 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl" (OuterVolumeSpecName: "kube-api-access-q65pl") pod "6869d579-ae16-44e0-8ae6-2fe5064ceb31" (UID: "6869d579-ae16-44e0-8ae6-2fe5064ceb31"). InnerVolumeSpecName "kube-api-access-q65pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:47:53.153301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.153282 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util" (OuterVolumeSpecName: "util") pod "6869d579-ae16-44e0-8ae6-2fe5064ceb31" (UID: "6869d579-ae16-44e0-8ae6-2fe5064ceb31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:53.250065 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.250029 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:53.250065 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.250061 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6869d579-ae16-44e0-8ae6-2fe5064ceb31-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:53.250065 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.250071 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q65pl\" (UniqueName: \"kubernetes.io/projected/6869d579-ae16-44e0-8ae6-2fe5064ceb31-kube-api-access-q65pl\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:47:53.904651 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.904619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" event={"ID":"6869d579-ae16-44e0-8ae6-2fe5064ceb31","Type":"ContainerDied","Data":"a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f"} Jul 09 14:47:53.904841 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.904663 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwt9r" Jul 09 14:47:53.904841 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:53.904666 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a71b8587b5f7e26993905d40e1cf1a2ca7863fbb404ae0542fb798cfe3a6cf8f" Jul 09 14:47:56.637391 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:56.637362 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:58.042352 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.042304 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:58.600676 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.600642 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l"] Jul 09 14:47:58.601037 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601020 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="extract" Jul 09 14:47:58.601121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601040 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="extract" Jul 09 14:47:58.601121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601054 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="pull" Jul 09 14:47:58.601121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601062 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="pull" Jul 09 14:47:58.601121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601077 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="util" Jul 09 14:47:58.601121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601084 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="util" Jul 09 14:47:58.601350 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.601159 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6869d579-ae16-44e0-8ae6-2fe5064ceb31" containerName="extract" Jul 09 14:47:58.603467 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.603445 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.607022 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.606997 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:47:58.607136 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.607028 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 14:47:58.607136 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.607025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6l4ql\"" Jul 09 14:47:58.621590 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.620127 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l"] Jul 09 14:47:58.691358 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.691326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf018f6-597a-4980-9f65-fed9c7343ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.691536 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.691380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmst\" (UniqueName: \"kubernetes.io/projected/caf018f6-597a-4980-9f65-fed9c7343ab1-kube-api-access-2nmst\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.792015 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.791983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf018f6-597a-4980-9f65-fed9c7343ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.792189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.792048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmst\" (UniqueName: \"kubernetes.io/projected/caf018f6-597a-4980-9f65-fed9c7343ab1-kube-api-access-2nmst\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.792371 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.792349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/caf018f6-597a-4980-9f65-fed9c7343ab1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.803230 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.803198 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmst\" (UniqueName: \"kubernetes.io/projected/caf018f6-597a-4980-9f65-fed9c7343ab1-kube-api-access-2nmst\") pod \"cert-manager-operator-controller-manager-55c444bf86-pb24l\" (UID: \"caf018f6-597a-4980-9f65-fed9c7343ab1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:58.913114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:58.913028 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" Jul 09 14:47:59.050295 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:59.050264 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l"] Jul 09 14:47:59.053933 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:47:59.053904 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf018f6_597a_4980_9f65_fed9c7343ab1.slice/crio-2c04e235bcbaf21c4a66a1b72811550170773e226d3383f408ba4c585002b02d WatchSource:0}: Error finding container 2c04e235bcbaf21c4a66a1b72811550170773e226d3383f408ba4c585002b02d: Status 404 returned error can't find the container with id 2c04e235bcbaf21c4a66a1b72811550170773e226d3383f408ba4c585002b02d Jul 09 14:47:59.931001 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:47:59.930962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" event={"ID":"caf018f6-597a-4980-9f65-fed9c7343ab1","Type":"ContainerStarted","Data":"2c04e235bcbaf21c4a66a1b72811550170773e226d3383f408ba4c585002b02d"} Jul 09 14:48:00.257416 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:00.257338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:00.358874 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:00.358835 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:00.937198 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:00.937116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" event={"ID":"caf018f6-597a-4980-9f65-fed9c7343ab1","Type":"ContainerStarted","Data":"f571f896ef59468872d9299fe97922f7f930d1bce337b3fd2d1585849be38390"} Jul 09 14:48:00.975001 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:00.974948 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pb24l" podStartSLOduration=1.3769072900000001 podStartE2EDuration="2.974921209s" totalImagesPullingTime="1.598013919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:00.969012898 +0000 UTC m=+472.280423521" watchObservedRunningTime="2026-07-09 14:48:00.974921209 +0000 UTC m=+472.286331821" Jul 09 14:48:01.397514 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:01.397466 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:01.527579 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:01.527538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:02.272035 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.271997 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc"] Jul 09 14:48:02.274430 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.274406 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.277476 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.277451 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:48:02.277602 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.277459 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:48:02.279150 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.279131 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mfs42\"" Jul 09 14:48:02.283740 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.283688 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc"] Jul 09 14:48:02.323220 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.323181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxp7\" (UniqueName: \"kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.323423 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.323251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.323423 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.323351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.424679 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.424639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.425127 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.424698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.425127 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.424771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxp7\" (UniqueName: \"kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.425301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.425145 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.425301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.425175 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.439845 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.439815 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxp7\" (UniqueName: \"kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.585225 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.585186 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:02.627144 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.627096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:02.721631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.721605 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc"] Jul 09 14:48:02.724122 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:02.724092 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd90271_d62d_493e_bd6a_a78357f0a3af.slice/crio-aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b WatchSource:0}: Error finding container aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b: Status 404 returned error can't find the container with id aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b Jul 09 14:48:02.724903 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.724864 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:02.734880 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.734856 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hql54"] Jul 09 14:48:02.737213 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.737094 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.740079 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.740053 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:48:02.740079 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.740073 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gkkh6\"" Jul 09 14:48:02.740246 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.740073 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:48:02.749032 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.749004 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hql54"] Jul 09 14:48:02.827228 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.827194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.827228 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.827241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxph\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-kube-api-access-lfxph\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.928192 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.928151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.928192 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.928198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxph\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-kube-api-access-lfxph\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.936573 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.936541 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.936755 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.936604 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxph\" (UniqueName: \"kubernetes.io/projected/92756699-88b3-487a-adc1-1e908f5daa04-kube-api-access-lfxph\") pod \"cert-manager-webhook-6486ffd997-hql54\" (UID: \"92756699-88b3-487a-adc1-1e908f5daa04\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:02.947825 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.947793 2572 generic.go:356] "Generic (PLEG): container finished" podID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerID="e260541cb027bad868cd3179ced43b439d1193e977a19433d981a9ff4bb84cce" exitCode=0 Jul 09 14:48:02.947997 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.947873 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" event={"ID":"2dd90271-d62d-493e-bd6a-a78357f0a3af","Type":"ContainerDied","Data":"e260541cb027bad868cd3179ced43b439d1193e977a19433d981a9ff4bb84cce"} Jul 09 14:48:02.947997 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:02.947931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" event={"ID":"2dd90271-d62d-493e-bd6a-a78357f0a3af","Type":"ContainerStarted","Data":"aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b"} Jul 09 14:48:03.077306 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:03.077264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:03.210465 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:03.210440 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hql54"] Jul 09 14:48:03.212498 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:03.212468 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92756699_88b3_487a_adc1_1e908f5daa04.slice/crio-95dc4c16338357ac00b07bb39b3f470814fca3674e50b45b0d75674b6568eaf2 WatchSource:0}: Error finding container 95dc4c16338357ac00b07bb39b3f470814fca3674e50b45b0d75674b6568eaf2: Status 404 returned error can't find the container with id 95dc4c16338357ac00b07bb39b3f470814fca3674e50b45b0d75674b6568eaf2 Jul 09 14:48:03.956155 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:03.956116 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" event={"ID":"92756699-88b3-487a-adc1-1e908f5daa04","Type":"ContainerStarted","Data":"95dc4c16338357ac00b07bb39b3f470814fca3674e50b45b0d75674b6568eaf2"} Jul 09 14:48:04.836999 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:04.836959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:05.030604 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:05.030571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:05.966543 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:05.966513 2572 generic.go:356] "Generic (PLEG): container finished" podID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerID="37852d2e69d77c6f3ba110efc34c3a5d5ac042cdbc7c1a17a8e2c64e26d9de01" exitCode=0 Jul 09 14:48:05.966701 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:05.966590 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" event={"ID":"2dd90271-d62d-493e-bd6a-a78357f0a3af","Type":"ContainerDied","Data":"37852d2e69d77c6f3ba110efc34c3a5d5ac042cdbc7c1a17a8e2c64e26d9de01"} Jul 09 14:48:06.972584 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:06.972546 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" event={"ID":"92756699-88b3-487a-adc1-1e908f5daa04","Type":"ContainerStarted","Data":"5ba4d30dad907784624f239fe5e5ab338413d14e4d7f3b522da1e4514bf03f05"} Jul 09 14:48:06.973073 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:06.972612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:06.974646 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:06.974621 2572 generic.go:356] "Generic (PLEG): container finished" podID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerID="e2cdd256db1d0f81c954aec584c5c0dae86d5bcce2808dd6b19e2ac36f225e0a" exitCode=0 Jul 09 14:48:06.974776 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:06.974697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" event={"ID":"2dd90271-d62d-493e-bd6a-a78357f0a3af","Type":"ContainerDied","Data":"e2cdd256db1d0f81c954aec584c5c0dae86d5bcce2808dd6b19e2ac36f225e0a"} Jul 09 14:48:06.992544 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:06.992500 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" podStartSLOduration=2.192202621 podStartE2EDuration="4.992487039s" totalImagesPullingTime="2.800284418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:06.991975113 +0000 UTC m=+478.303385724" watchObservedRunningTime="2026-07-09 14:48:06.992487039 +0000 UTC m=+478.303897650" Jul 09 14:48:07.251254 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:07.251176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:07.350244 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:07.350202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:08.104070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.104046 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:08.176609 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.176574 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util\") pod \"2dd90271-d62d-493e-bd6a-a78357f0a3af\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " Jul 09 14:48:08.176803 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.176631 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle\") pod \"2dd90271-d62d-493e-bd6a-a78357f0a3af\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " Jul 09 14:48:08.176803 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.176683 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlxp7\" (UniqueName: \"kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7\") pod \"2dd90271-d62d-493e-bd6a-a78357f0a3af\" (UID: \"2dd90271-d62d-493e-bd6a-a78357f0a3af\") " Jul 09 14:48:08.177039 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.177010 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle" (OuterVolumeSpecName: "bundle") pod "2dd90271-d62d-493e-bd6a-a78357f0a3af" (UID: "2dd90271-d62d-493e-bd6a-a78357f0a3af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:48:08.178890 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.178869 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7" (OuterVolumeSpecName: "kube-api-access-qlxp7") pod "2dd90271-d62d-493e-bd6a-a78357f0a3af" (UID: "2dd90271-d62d-493e-bd6a-a78357f0a3af"). InnerVolumeSpecName "kube-api-access-qlxp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:48:08.274024 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.273992 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util" (OuterVolumeSpecName: "util") pod "2dd90271-d62d-493e-bd6a-a78357f0a3af" (UID: "2dd90271-d62d-493e-bd6a-a78357f0a3af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:48:08.277512 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.277488 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:08.277512 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.277512 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2dd90271-d62d-493e-bd6a-a78357f0a3af-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:08.277651 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.277525 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlxp7\" (UniqueName: \"kubernetes.io/projected/2dd90271-d62d-493e-bd6a-a78357f0a3af-kube-api-access-qlxp7\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:08.984388 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.984348 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" event={"ID":"2dd90271-d62d-493e-bd6a-a78357f0a3af","Type":"ContainerDied","Data":"aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b"} Jul 09 14:48:08.984388 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.984391 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5vmgc" Jul 09 14:48:08.984596 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:08.984398 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aae49de55613dc4f3b741d1c50c04d7c284fa34bd8cc9ea46cd14ef386149f4b" Jul 09 14:48:09.394016 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:09.393983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:09.495463 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:09.495429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:12.981837 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:12.981802 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hql54" Jul 09 14:48:13.038318 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:13.038285 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:13.263713 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:13.263616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:13.397443 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:13.397405 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:15.481736 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.481698 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5"] Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482030 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="pull" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482042 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="pull" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482059 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="util" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482064 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="util" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482075 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="extract" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482081 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="extract" Jul 09 14:48:15.482188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.482131 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dd90271-d62d-493e-bd6a-a78357f0a3af" containerName="extract" Jul 09 14:48:15.532422 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.532386 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5"] Jul 09 14:48:15.532586 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.532486 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.535625 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.535601 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:48:15.535788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.535632 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9wmnp\"" Jul 09 14:48:15.535788 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.535699 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:48:15.643844 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.643811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.644026 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.643865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfh2\" (UniqueName: \"kubernetes.io/projected/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-kube-api-access-8gfh2\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.744297 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.744216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfh2\" (UniqueName: \"kubernetes.io/projected/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-kube-api-access-8gfh2\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.744297 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.744276 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.744607 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.744592 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.753176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.753145 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfh2\" (UniqueName: \"kubernetes.io/projected/2fb0a635-e72a-4c02-88d8-5c65d2b33a68-kube-api-access-8gfh2\") pod \"openshift-lws-operator-fd8ccff4c-jl8c5\" (UID: \"2fb0a635-e72a-4c02-88d8-5c65d2b33a68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:15.842246 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:15.842211 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" Jul 09 14:48:16.015990 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:16.015959 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5"] Jul 09 14:48:16.017019 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:16.016994 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fb0a635_e72a_4c02_88d8_5c65d2b33a68.slice/crio-d1f15039f3da3cda5d4cb9110aba39894a36724de03a0fc3a87bae94257766d6 WatchSource:0}: Error finding container d1f15039f3da3cda5d4cb9110aba39894a36724de03a0fc3a87bae94257766d6: Status 404 returned error can't find the container with id d1f15039f3da3cda5d4cb9110aba39894a36724de03a0fc3a87bae94257766d6 Jul 09 14:48:17.029916 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:17.029881 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" event={"ID":"2fb0a635-e72a-4c02-88d8-5c65d2b33a68","Type":"ContainerStarted","Data":"d1f15039f3da3cda5d4cb9110aba39894a36724de03a0fc3a87bae94257766d6"} Jul 09 14:48:19.039823 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:19.039787 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" event={"ID":"2fb0a635-e72a-4c02-88d8-5c65d2b33a68","Type":"ContainerStarted","Data":"c6e7098b9ff4e7f8875a34c302aad910b48be0a8a0f2aeeb4b5bcd532e7da8fb"} Jul 09 14:48:19.058915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:19.058868 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jl8c5" podStartSLOduration=1.710108336 podStartE2EDuration="4.058852504s" totalImagesPullingTime="2.348744168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:19.05771179 +0000 UTC m=+490.369122402" watchObservedRunningTime="2026-07-09 14:48:19.058852504 +0000 UTC m=+490.370263115" Jul 09 14:48:19.817057 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:19.817024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:19.915184 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:19.915143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:21.861868 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:21.861824 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:23.325357 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.325321 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6"] Jul 09 14:48:23.327798 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.327782 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.330936 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.330912 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 14:48:23.331055 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.330974 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 14:48:23.332374 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.332357 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mfs42\"" Jul 09 14:48:23.337836 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.337818 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6"] Jul 09 14:48:23.513463 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.513427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntkh4\" (UniqueName: \"kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.513654 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.513496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.513654 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.513518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.614276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.614190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.614276 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.614234 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.614501 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.614296 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntkh4\" (UniqueName: \"kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.614683 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.614659 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.614785 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.614680 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.623899 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.623872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntkh4\" (UniqueName: \"kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.636853 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.636823 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:23.774079 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:23.774057 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6"] Jul 09 14:48:23.776150 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:23.776113 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf467a0b8_4695_40d5_a2b8_4ba93c3dbad8.slice/crio-aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029 WatchSource:0}: Error finding container aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029: Status 404 returned error can't find the container with id aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029 Jul 09 14:48:24.063357 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:24.063324 2572 generic.go:356] "Generic (PLEG): container finished" podID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerID="755b58da88fc7ccfce447dc4e51dfc832601777493db588bd95485cf643b8093" exitCode=0 Jul 09 14:48:24.063525 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:24.063409 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" event={"ID":"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8","Type":"ContainerDied","Data":"755b58da88fc7ccfce447dc4e51dfc832601777493db588bd95485cf643b8093"} Jul 09 14:48:24.063525 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:24.063465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" event={"ID":"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8","Type":"ContainerStarted","Data":"aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029"} Jul 09 14:48:25.070126 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:25.070090 2572 generic.go:356] "Generic (PLEG): container finished" podID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerID="58643f65d03c2f269b9b7b1e757440bc6d64d2a6a3a544b6071b0a9e6981e0e6" exitCode=0 Jul 09 14:48:25.070508 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:25.070128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" event={"ID":"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8","Type":"ContainerDied","Data":"58643f65d03c2f269b9b7b1e757440bc6d64d2a6a3a544b6071b0a9e6981e0e6"} Jul 09 14:48:26.077094 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:26.077062 2572 generic.go:356] "Generic (PLEG): container finished" podID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerID="4fea9f5be01f47422dc5eb35d9e978680f32a42243e92cb914aba8f940c2e739" exitCode=0 Jul 09 14:48:26.077453 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:26.077145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" event={"ID":"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8","Type":"ContainerDied","Data":"4fea9f5be01f47422dc5eb35d9e978680f32a42243e92cb914aba8f940c2e739"} Jul 09 14:48:27.205675 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.205652 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:27.345635 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.345543 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util\") pod \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " Jul 09 14:48:27.345635 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.345584 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle\") pod \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " Jul 09 14:48:27.345868 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.345648 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntkh4\" (UniqueName: \"kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4\") pod \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\" (UID: \"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8\") " Jul 09 14:48:27.346366 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.346331 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle" (OuterVolumeSpecName: "bundle") pod "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" (UID: "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:48:27.347943 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.347915 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4" (OuterVolumeSpecName: "kube-api-access-ntkh4") pod "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" (UID: "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8"). InnerVolumeSpecName "kube-api-access-ntkh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:48:27.351805 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.351779 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util" (OuterVolumeSpecName: "util") pod "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" (UID: "f467a0b8-4695-40d5-a2b8-4ba93c3dbad8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:48:27.446409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.446374 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntkh4\" (UniqueName: \"kubernetes.io/projected/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-kube-api-access-ntkh4\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:27.446409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.446406 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:27.446409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:27.446417 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f467a0b8-4695-40d5-a2b8-4ba93c3dbad8-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:48:28.087631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:28.087606 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" Jul 09 14:48:28.087862 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:28.087605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7qll6" event={"ID":"f467a0b8-4695-40d5-a2b8-4ba93c3dbad8","Type":"ContainerDied","Data":"aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029"} Jul 09 14:48:28.087862 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:28.087747 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa2a0818997404d94e1697d54018988f133c114a96ba75ef58cfba78f01a1029" Jul 09 14:48:33.847753 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:33.847693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:33.947903 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:33.947868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:34.520261 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.520225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:34.680511 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.680481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:34.780540 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.780495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:34.826212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826177 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r"] Jul 09 14:48:34.826501 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826490 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="pull" Jul 09 14:48:34.826546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826503 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="pull" Jul 09 14:48:34.826546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826516 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="util" Jul 09 14:48:34.826546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826521 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="util" Jul 09 14:48:34.826546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826531 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="extract" Jul 09 14:48:34.826546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826536 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="extract" Jul 09 14:48:34.826690 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.826589 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f467a0b8-4695-40d5-a2b8-4ba93c3dbad8" containerName="extract" Jul 09 14:48:34.828822 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.828806 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.832408 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.832385 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:48:34.832516 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.832439 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:48:34.832582 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.832520 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9mjvj\"" Jul 09 14:48:34.832802 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.832784 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:48:34.833336 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.833319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:48:34.857745 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.845593 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r"] Jul 09 14:48:34.900143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.900103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92c9\" (UniqueName: \"kubernetes.io/projected/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-kube-api-access-f92c9\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.900143 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.900144 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.900349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.900207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.900349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.900233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.900349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.900307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:34.965899 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:34.965863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:35.000941 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.000903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.001114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.000959 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.001114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.001011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92c9\" (UniqueName: \"kubernetes.io/projected/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-kube-api-access-f92c9\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.001114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.001038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.001114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.001084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.001342 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.001319 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-manifests\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.003434 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.003404 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-tmp\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.003687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.003666 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.003793 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.003773 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.023410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.023384 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92c9\" (UniqueName: \"kubernetes.io/projected/f1ecbc32-4a0d-44a7-8bce-f33b2e694073-kube-api-access-f92c9\") pod \"opendatahub-operator-controller-manager-6dd54665dd-5gt6r\" (UID: \"f1ecbc32-4a0d-44a7-8bce-f33b2e694073\") " pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.098245 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.098164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:35.139471 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.139440 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:35.195320 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.195263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:35.286238 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.286212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r"] Jul 09 14:48:35.287872 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:35.287848 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ecbc32_4a0d_44a7_8bce_f33b2e694073.slice/crio-f43046c3c3642438a7d8cdfcf083194621e80cf960cc2c7a03765c819a312f05 WatchSource:0}: Error finding container f43046c3c3642438a7d8cdfcf083194621e80cf960cc2c7a03765c819a312f05: Status 404 returned error can't find the container with id f43046c3c3642438a7d8cdfcf083194621e80cf960cc2c7a03765c819a312f05 Jul 09 14:48:35.292826 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.292798 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:35.425233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:35.425145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:36.132928 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:36.132866 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" event={"ID":"f1ecbc32-4a0d-44a7-8bce-f33b2e694073","Type":"ContainerStarted","Data":"f43046c3c3642438a7d8cdfcf083194621e80cf960cc2c7a03765c819a312f05"} Jul 09 14:48:39.150405 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:39.150373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" event={"ID":"f1ecbc32-4a0d-44a7-8bce-f33b2e694073","Type":"ContainerStarted","Data":"93e31f9fc6286e6ec2d2655c7f1f2efb6e5be05d953950662c49d2dc6dea4999"} Jul 09 14:48:40.157644 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:40.157605 2572 generic.go:356] "Generic (PLEG): container finished" podID="f1ecbc32-4a0d-44a7-8bce-f33b2e694073" containerID="93e31f9fc6286e6ec2d2655c7f1f2efb6e5be05d953950662c49d2dc6dea4999" exitCode=0 Jul 09 14:48:40.158040 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:40.157665 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" event={"ID":"f1ecbc32-4a0d-44a7-8bce-f33b2e694073","Type":"ContainerDied","Data":"93e31f9fc6286e6ec2d2655c7f1f2efb6e5be05d953950662c49d2dc6dea4999"} Jul 09 14:48:41.164160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:41.164122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" event={"ID":"f1ecbc32-4a0d-44a7-8bce-f33b2e694073","Type":"ContainerStarted","Data":"6869e334a91ddf860fe3a7d0634ff434dce6f19f515f6d7099a43bb938639ea6"} Jul 09 14:48:41.164528 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:41.164259 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:41.189903 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:41.189850 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" podStartSLOduration=2.853664976 podStartE2EDuration="7.189824106s" totalImagesPullingTime="3.307404402s" totalInitContainerRuntime="1.028754728s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:41.187231249 +0000 UTC m=+512.498641870" watchObservedRunningTime="2026-07-09 14:48:41.189824106 +0000 UTC m=+512.501234717" Jul 09 14:48:50.388941 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:50.388907 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:50.494627 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:50.494588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:52.171648 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.171614 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dd54665dd-5gt6r" Jul 09 14:48:52.366692 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.366659 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl"] Jul 09 14:48:52.489749 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.489631 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl"] Jul 09 14:48:52.489920 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.489770 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.493179 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.493161 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:48:52.493292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.493226 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:48:52.493372 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.493360 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r2xpw\"" Jul 09 14:48:52.493454 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.493442 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:48:52.526560 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.526529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c20cbeff-0734-4005-9114-8703dde41fb5-manager-config\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.526762 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.526589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.526762 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.526623 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-metrics-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.526762 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.526649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx48p\" (UniqueName: \"kubernetes.io/projected/c20cbeff-0734-4005-9114-8703dde41fb5-kube-api-access-hx48p\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.627497 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.627460 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c20cbeff-0734-4005-9114-8703dde41fb5-manager-config\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.627680 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.627522 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.627680 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.627551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-metrics-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.627680 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.627570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx48p\" (UniqueName: \"kubernetes.io/projected/c20cbeff-0734-4005-9114-8703dde41fb5-kube-api-access-hx48p\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.628187 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.628155 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c20cbeff-0734-4005-9114-8703dde41fb5-manager-config\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.630223 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.630202 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.630306 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.630260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c20cbeff-0734-4005-9114-8703dde41fb5-metrics-cert\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.638774 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.638749 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx48p\" (UniqueName: \"kubernetes.io/projected/c20cbeff-0734-4005-9114-8703dde41fb5-kube-api-access-hx48p\") pod \"lws-controller-manager-756d646c97-dc7nl\" (UID: \"c20cbeff-0734-4005-9114-8703dde41fb5\") " pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.799616 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.799577 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:52.953955 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:52.953919 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl"] Jul 09 14:48:52.957571 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:48:52.957545 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20cbeff_0734_4005_9114_8703dde41fb5.slice/crio-df454f913704b6ccdc5dec50f6bc1692933cbba56bc01e94a51115489cb95ab8 WatchSource:0}: Error finding container df454f913704b6ccdc5dec50f6bc1692933cbba56bc01e94a51115489cb95ab8: Status 404 returned error can't find the container with id df454f913704b6ccdc5dec50f6bc1692933cbba56bc01e94a51115489cb95ab8 Jul 09 14:48:53.226677 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:53.226586 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" event={"ID":"c20cbeff-0734-4005-9114-8703dde41fb5","Type":"ContainerStarted","Data":"df454f913704b6ccdc5dec50f6bc1692933cbba56bc01e94a51115489cb95ab8"} Jul 09 14:48:53.847042 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:53.847006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:53.984301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:53.984264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:54.607665 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:54.607626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:54.715684 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:54.715655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:54.854043 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:54.854012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:55.149319 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.149283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:55.238234 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.238198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" event={"ID":"c20cbeff-0734-4005-9114-8703dde41fb5","Type":"ContainerStarted","Data":"3f17d8842ef273ec9464afc3e34da86c97827060e81f11dd9f6574cc145e545b"} Jul 09 14:48:55.238424 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.238256 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:48:55.255595 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.255560 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:55.259521 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.259478 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" podStartSLOduration=1.509734222 podStartE2EDuration="3.259461784s" totalImagesPullingTime="1.749727562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:48:55.257784793 +0000 UTC m=+526.569195405" watchObservedRunningTime="2026-07-09 14:48:55.259461784 +0000 UTC m=+526.570872395" Jul 09 14:48:55.379736 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.379675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:55.766483 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:55.766445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:56.442561 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:56.442526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:56.525579 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:56.525549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:48:57.512781 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:48:57.512746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:01.718233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.718145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:01.862409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.862376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:01.917909 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.917879 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48"] Jul 09 14:49:01.919971 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.919956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:01.923128 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.923098 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:49:01.923128 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.923111 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-w7xp9\"" Jul 09 14:49:01.923333 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.923144 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:49:01.923417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.923401 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:49:01.938410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.938383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48"] Jul 09 14:49:01.959043 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:01.958998 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:02.014496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014561 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbf4q\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-kube-api-access-bbf4q\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.014759 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.014657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.051843 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.051796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:02.115225 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115225 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115251 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115276 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbf4q\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-kube-api-access-bbf4q\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115444 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115752 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115752 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115752 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115613 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.115926 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115878 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.116019 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.115989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.116019 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.116006 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.116365 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.116276 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.117872 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.117839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.118093 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.118077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.124038 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.124017 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.124224 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.124204 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbf4q\" (UniqueName: \"kubernetes.io/projected/d20db7f9-bc04-4edf-9b10-cbd4454e9d99-kube-api-access-bbf4q\") pod \"data-science-gateway-data-science-gateway-class-695cd9447dqxh48\" (UID: \"d20db7f9-bc04-4edf-9b10-cbd4454e9d99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.215110 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.215079 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r"] Jul 09 14:49:02.217894 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.217874 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.225067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.224884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:49:02.225067 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.224909 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:49:02.229918 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.229896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:02.231886 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.231598 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:49:02.231947 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.231907 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-s55xz\"" Jul 09 14:49:02.245889 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.245830 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r"] Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcnh2\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-kube-api-access-tcnh2\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.318070 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.317913 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.399915 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.399886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48"] Jul 09 14:49:02.401354 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:49:02.401327 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20db7f9_bc04_4edf_9b10_cbd4454e9d99.slice/crio-5a3333c69897d11f979729ffcc094d7fe6c83f58d3ee3ab8744ae8142ae8cb43 WatchSource:0}: Error finding container 5a3333c69897d11f979729ffcc094d7fe6c83f58d3ee3ab8744ae8142ae8cb43: Status 404 returned error can't find the container with id 5a3333c69897d11f979729ffcc094d7fe6c83f58d3ee3ab8744ae8142ae8cb43 Jul 09 14:49:02.418987 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.418962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419039 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419071 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419114 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcnh2\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-kube-api-access-tcnh2\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419258 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.419995 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.419973 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.421619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.421590 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.421619 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.421603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.421782 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.421765 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.421902 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.421885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.430857 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.430828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.430947 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.430907 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcnh2\" (UniqueName: \"kubernetes.io/projected/a6303d73-ea5d-40e9-b1bc-35c6f42ff16a-kube-api-access-tcnh2\") pod \"istiod-openshift-gateway-94bb8fbfd-tqt7r\" (UID: \"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.527479 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.527440 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:02.668967 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.668940 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r"] Jul 09 14:49:02.670500 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:49:02.670474 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6303d73_ea5d_40e9_b1bc_35c6f42ff16a.slice/crio-8d2a9f9cf240be1eaf7a1330571cc2bc565479a48b3b98796b28e3c590ee8510 WatchSource:0}: Error finding container 8d2a9f9cf240be1eaf7a1330571cc2bc565479a48b3b98796b28e3c590ee8510: Status 404 returned error can't find the container with id 8d2a9f9cf240be1eaf7a1330571cc2bc565479a48b3b98796b28e3c590ee8510 Jul 09 14:49:02.878486 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:02.878396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:03.277571 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:03.277521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" event={"ID":"d20db7f9-bc04-4edf-9b10-cbd4454e9d99","Type":"ContainerStarted","Data":"5a3333c69897d11f979729ffcc094d7fe6c83f58d3ee3ab8744ae8142ae8cb43"} Jul 09 14:49:03.279017 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:03.278990 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" event={"ID":"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a","Type":"ContainerStarted","Data":"8d2a9f9cf240be1eaf7a1330571cc2bc565479a48b3b98796b28e3c590ee8510"} Jul 09 14:49:04.879117 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:04.879082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:04.998608 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:04.998572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:05.336551 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:05.336508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:05.550002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:05.549963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:06.117625 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.117579 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:49:06.118013 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.117679 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:49:06.118142 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.118109 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:49:06.118233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.118192 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:49:06.118271 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.118237 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:49:06.152048 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.152018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:06.245232 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.245206 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-756d646c97-dc7nl" Jul 09 14:49:06.302657 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.302607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" event={"ID":"d20db7f9-bc04-4edf-9b10-cbd4454e9d99","Type":"ContainerStarted","Data":"944d6ecb6745fc9e54a5e918d80ae50764cda0a792b81bb7cb74867614bfbc6d"} Jul 09 14:49:06.305653 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.305622 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" event={"ID":"a6303d73-ea5d-40e9-b1bc-35c6f42ff16a","Type":"ContainerStarted","Data":"13d4d24cdf0f2c9f8617ac9c20969b757d86cdad8e826ae9f1edc0c1f812e637"} Jul 09 14:49:06.305819 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.305691 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:06.346803 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.346745 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" podStartSLOduration=1.632173111 podStartE2EDuration="5.346707852s" totalImagesPullingTime="3.714534741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:49:06.344992136 +0000 UTC m=+537.656402772" watchObservedRunningTime="2026-07-09 14:49:06.346707852 +0000 UTC m=+537.658118464" Jul 09 14:49:06.376108 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.375988 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" podStartSLOduration=0.931310279 podStartE2EDuration="4.375967399s" totalImagesPullingTime="3.44465712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:49:06.375024443 +0000 UTC m=+537.686435055" watchObservedRunningTime="2026-07-09 14:49:06.375967399 +0000 UTC m=+537.687378011" Jul 09 14:49:06.629323 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:06.629191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:07.230924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:07.230885 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:07.235399 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:07.235376 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:07.316385 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:07.316347 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:07.317123 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:07.317102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-695cd9447dqxh48" Jul 09 14:49:07.317816 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:07.317799 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tqt7r" Jul 09 14:49:28.233170 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:28.233133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:29.478171 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:29.478137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:29.578907 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:29.578867 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:54.442149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:54.442110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:55.481927 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:55.481891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:55.632607 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:55.632573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:49:55.751574 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:49:55.751474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:09.152964 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:09.150916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:50:09.153565 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:09.153544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:50:09.155496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:09.155468 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:50:09.156006 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:09.155987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:50:11.155625 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.155596 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh"] Jul 09 14:50:11.158058 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.158042 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.161430 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.161401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nds7q\"" Jul 09 14:50:11.161430 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.161413 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:50:11.161607 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.161407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:50:11.169771 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.169745 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh"] Jul 09 14:50:11.337349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.337292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.337349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.337350 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.337577 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.337412 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kzc\" (UniqueName: \"kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.438601 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.438506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.438601 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.438544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.438871 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.438672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kzc\" (UniqueName: \"kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.439105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.438950 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.439105 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.439040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.449282 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.449258 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kzc\" (UniqueName: \"kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.467255 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.467231 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:11.620648 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:11.620501 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh"] Jul 09 14:50:11.623675 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:50:11.623640 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fc6073_f4b7_4be2_87df_bba9e04aef4a.slice/crio-0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a WatchSource:0}: Error finding container 0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a: Status 404 returned error can't find the container with id 0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a Jul 09 14:50:12.010218 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.010137 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl"] Jul 09 14:50:12.012590 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.012574 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.034412 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.034376 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl"] Jul 09 14:50:12.145432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.145384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.145432 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.145434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fcd\" (UniqueName: \"kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.145662 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.145505 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.247026 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.246970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.247419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.247063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.247419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.247083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fcd\" (UniqueName: \"kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.247419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.247343 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.247419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.247382 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.259385 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.259360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fcd\" (UniqueName: \"kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.321410 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.321378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:12.463860 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.463837 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl"] Jul 09 14:50:12.465464 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:50:12.465440 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc584b607_9382_4e65_9500_01eb399a17f0.slice/crio-1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf WatchSource:0}: Error finding container 1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf: Status 404 returned error can't find the container with id 1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf Jul 09 14:50:12.629532 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.629496 2572 generic.go:356] "Generic (PLEG): container finished" podID="c584b607-9382-4e65-9500-01eb399a17f0" containerID="933ba64a95e37228e892d945da873c1194ac78f9662e306d61ddf433b8b77451" exitCode=0 Jul 09 14:50:12.629709 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.629588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" event={"ID":"c584b607-9382-4e65-9500-01eb399a17f0","Type":"ContainerDied","Data":"933ba64a95e37228e892d945da873c1194ac78f9662e306d61ddf433b8b77451"} Jul 09 14:50:12.629709 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.629636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" event={"ID":"c584b607-9382-4e65-9500-01eb399a17f0","Type":"ContainerStarted","Data":"1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf"} Jul 09 14:50:12.630137 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.630120 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:50:12.631160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.631140 2572 generic.go:356] "Generic (PLEG): container finished" podID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerID="fa344d98be96afad42f1628387f3b4a46cce3fa894e26e4893539c9e97bad89d" exitCode=0 Jul 09 14:50:12.631257 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.631200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" event={"ID":"69fc6073-f4b7-4be2-87df-bba9e04aef4a","Type":"ContainerDied","Data":"fa344d98be96afad42f1628387f3b4a46cce3fa894e26e4893539c9e97bad89d"} Jul 09 14:50:12.631257 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.631243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" event={"ID":"69fc6073-f4b7-4be2-87df-bba9e04aef4a","Type":"ContainerStarted","Data":"0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a"} Jul 09 14:50:12.643564 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.643534 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb"] Jul 09 14:50:12.646339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.646323 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.702277 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.702246 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb"] Jul 09 14:50:12.751225 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.751190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.751396 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.751286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.751396 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.751307 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvlpk\" (UniqueName: \"kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.852886 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.852793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.852886 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.852835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvlpk\" (UniqueName: \"kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.853125 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.852904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.853222 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.853200 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.853285 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.853217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.868142 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.868104 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvlpk\" (UniqueName: \"kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:12.954992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:12.954955 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:13.114995 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.114970 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb"] Jul 09 14:50:13.116146 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:50:13.116116 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70f1612_a9ed_48e4_bd8c_200dd4f21d31.slice/crio-e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c WatchSource:0}: Error finding container e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c: Status 404 returned error can't find the container with id e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c Jul 09 14:50:13.201854 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.200267 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq"] Jul 09 14:50:13.207904 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.207877 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.215994 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.215941 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq"] Jul 09 14:50:13.356672 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.356646 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.357074 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.356687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.357074 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.356845 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pplh\" (UniqueName: \"kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.458378 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.458347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.458546 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.458502 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.458647 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.458628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pplh\" (UniqueName: \"kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.458802 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.458777 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.458893 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.458861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.470938 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.470915 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pplh\" (UniqueName: \"kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.588341 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.588315 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:13.646171 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.646136 2572 generic.go:356] "Generic (PLEG): container finished" podID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerID="636d8631ba860dfccc95576d3f6fa95f48ca122074112c0e864f6b53cda06d3c" exitCode=0 Jul 09 14:50:13.646341 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.646250 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" event={"ID":"69fc6073-f4b7-4be2-87df-bba9e04aef4a","Type":"ContainerDied","Data":"636d8631ba860dfccc95576d3f6fa95f48ca122074112c0e864f6b53cda06d3c"} Jul 09 14:50:13.648383 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.648331 2572 generic.go:356] "Generic (PLEG): container finished" podID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerID="16881a90e4d0951bdd02e274b1d66be00dabc39d93d364512b4f0e73e39472ab" exitCode=0 Jul 09 14:50:13.648748 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.648523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" event={"ID":"f70f1612-a9ed-48e4-bd8c-200dd4f21d31","Type":"ContainerDied","Data":"16881a90e4d0951bdd02e274b1d66be00dabc39d93d364512b4f0e73e39472ab"} Jul 09 14:50:13.648748 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.648556 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" event={"ID":"f70f1612-a9ed-48e4-bd8c-200dd4f21d31","Type":"ContainerStarted","Data":"e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c"} Jul 09 14:50:13.754508 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:13.754482 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq"] Jul 09 14:50:13.755068 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:50:13.755039 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3332bd09_ea20_4f05_9fed_865f1cde29a8.slice/crio-3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742 WatchSource:0}: Error finding container 3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742: Status 404 returned error can't find the container with id 3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742 Jul 09 14:50:14.656235 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.656206 2572 generic.go:356] "Generic (PLEG): container finished" podID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerID="e7de8fdb1ad9f7470d1257c3ef97e248c30d2380312d89f523a21220493d3cf4" exitCode=0 Jul 09 14:50:14.656588 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.656292 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" event={"ID":"69fc6073-f4b7-4be2-87df-bba9e04aef4a","Type":"ContainerDied","Data":"e7de8fdb1ad9f7470d1257c3ef97e248c30d2380312d89f523a21220493d3cf4"} Jul 09 14:50:14.657835 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.657813 2572 generic.go:356] "Generic (PLEG): container finished" podID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerID="56d8e1beb086e389020854d8bdc7886a7b40d810ebafdcf487b13145c6977fd0" exitCode=0 Jul 09 14:50:14.657959 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.657845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" event={"ID":"3332bd09-ea20-4f05-9fed-865f1cde29a8","Type":"ContainerDied","Data":"56d8e1beb086e389020854d8bdc7886a7b40d810ebafdcf487b13145c6977fd0"} Jul 09 14:50:14.657959 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.657899 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" event={"ID":"3332bd09-ea20-4f05-9fed-865f1cde29a8","Type":"ContainerStarted","Data":"3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742"} Jul 09 14:50:14.659891 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.659866 2572 generic.go:356] "Generic (PLEG): container finished" podID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerID="5ec2732cf08c94991e03e73715568cc1bb54895023a44bf7eab391ce9b39ac64" exitCode=0 Jul 09 14:50:14.659991 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.659938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" event={"ID":"f70f1612-a9ed-48e4-bd8c-200dd4f21d31","Type":"ContainerDied","Data":"5ec2732cf08c94991e03e73715568cc1bb54895023a44bf7eab391ce9b39ac64"} Jul 09 14:50:14.662004 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.661982 2572 generic.go:356] "Generic (PLEG): container finished" podID="c584b607-9382-4e65-9500-01eb399a17f0" containerID="67b62443ff1211d2155989a7e009d24bc3ac1a45fc83a03419de74ac49d1cc1a" exitCode=0 Jul 09 14:50:14.662090 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.662019 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" event={"ID":"c584b607-9382-4e65-9500-01eb399a17f0","Type":"ContainerDied","Data":"67b62443ff1211d2155989a7e009d24bc3ac1a45fc83a03419de74ac49d1cc1a"} Jul 09 14:50:14.711496 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:14.711462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:15.160988 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.160949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:15.648914 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.648875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:15.676089 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.676050 2572 generic.go:356] "Generic (PLEG): container finished" podID="c584b607-9382-4e65-9500-01eb399a17f0" containerID="a916a2b9d788d81c7a5ef628823326acf3085275c2bb74eb56070823eeea6641" exitCode=0 Jul 09 14:50:15.676492 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.676105 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" event={"ID":"c584b607-9382-4e65-9500-01eb399a17f0","Type":"ContainerDied","Data":"a916a2b9d788d81c7a5ef628823326acf3085275c2bb74eb56070823eeea6641"} Jul 09 14:50:15.678149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.678125 2572 generic.go:356] "Generic (PLEG): container finished" podID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerID="9d209db38889b3f10122a7604113f8a2e733661a3c52bf9153812f7d21a6ebc7" exitCode=0 Jul 09 14:50:15.678279 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.678196 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" event={"ID":"3332bd09-ea20-4f05-9fed-865f1cde29a8","Type":"ContainerDied","Data":"9d209db38889b3f10122a7604113f8a2e733661a3c52bf9153812f7d21a6ebc7"} Jul 09 14:50:15.680349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.680327 2572 generic.go:356] "Generic (PLEG): container finished" podID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerID="4881d394cf2c9b674541680263491f0a7040ab5bbe5f077465dd618600da2d2c" exitCode=0 Jul 09 14:50:15.680435 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.680399 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" event={"ID":"f70f1612-a9ed-48e4-bd8c-200dd4f21d31","Type":"ContainerDied","Data":"4881d394cf2c9b674541680263491f0a7040ab5bbe5f077465dd618600da2d2c"} Jul 09 14:50:15.818887 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.818860 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:15.979798 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.979677 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util\") pod \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " Jul 09 14:50:15.979798 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.979715 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle\") pod \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " Jul 09 14:50:15.979975 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.979862 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2kzc\" (UniqueName: \"kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc\") pod \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\" (UID: \"69fc6073-f4b7-4be2-87df-bba9e04aef4a\") " Jul 09 14:50:15.980353 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.980320 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle" (OuterVolumeSpecName: "bundle") pod "69fc6073-f4b7-4be2-87df-bba9e04aef4a" (UID: "69fc6073-f4b7-4be2-87df-bba9e04aef4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:15.982322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.982296 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc" (OuterVolumeSpecName: "kube-api-access-h2kzc") pod "69fc6073-f4b7-4be2-87df-bba9e04aef4a" (UID: "69fc6073-f4b7-4be2-87df-bba9e04aef4a"). InnerVolumeSpecName "kube-api-access-h2kzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:50:15.985815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:15.985781 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util" (OuterVolumeSpecName: "util") pod "69fc6073-f4b7-4be2-87df-bba9e04aef4a" (UID: "69fc6073-f4b7-4be2-87df-bba9e04aef4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:16.080924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.080888 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2kzc\" (UniqueName: \"kubernetes.io/projected/69fc6073-f4b7-4be2-87df-bba9e04aef4a-kube-api-access-h2kzc\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.080924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.080918 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.080924 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.080930 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69fc6073-f4b7-4be2-87df-bba9e04aef4a-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.687395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.687357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" event={"ID":"69fc6073-f4b7-4be2-87df-bba9e04aef4a","Type":"ContainerDied","Data":"0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a"} Jul 09 14:50:16.687898 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.687421 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecbdbfe8ce1bbe00b8cf0581f396477d99d786a4c16bb59d2343851ed560e8a" Jul 09 14:50:16.687898 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.687372 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh" Jul 09 14:50:16.689659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.689627 2572 generic.go:356] "Generic (PLEG): container finished" podID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerID="a3eda1aa44ba102203119b8ba2bb7edfc3a659590300551f4d9085aabddb9192" exitCode=0 Jul 09 14:50:16.689830 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.689687 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" event={"ID":"3332bd09-ea20-4f05-9fed-865f1cde29a8","Type":"ContainerDied","Data":"a3eda1aa44ba102203119b8ba2bb7edfc3a659590300551f4d9085aabddb9192"} Jul 09 14:50:16.823576 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.823548 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:16.858082 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.858048 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:16.888043 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888005 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle\") pod \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " Jul 09 14:50:16.888043 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888038 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util\") pod \"c584b607-9382-4e65-9500-01eb399a17f0\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " Jul 09 14:50:16.888292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888061 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle\") pod \"c584b607-9382-4e65-9500-01eb399a17f0\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " Jul 09 14:50:16.888292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888082 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9fcd\" (UniqueName: \"kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd\") pod \"c584b607-9382-4e65-9500-01eb399a17f0\" (UID: \"c584b607-9382-4e65-9500-01eb399a17f0\") " Jul 09 14:50:16.888292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888107 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util\") pod \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " Jul 09 14:50:16.888292 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888145 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvlpk\" (UniqueName: \"kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk\") pod \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\" (UID: \"f70f1612-a9ed-48e4-bd8c-200dd4f21d31\") " Jul 09 14:50:16.888981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888578 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle" (OuterVolumeSpecName: "bundle") pod "f70f1612-a9ed-48e4-bd8c-200dd4f21d31" (UID: "f70f1612-a9ed-48e4-bd8c-200dd4f21d31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:16.888981 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.888590 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle" (OuterVolumeSpecName: "bundle") pod "c584b607-9382-4e65-9500-01eb399a17f0" (UID: "c584b607-9382-4e65-9500-01eb399a17f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:16.890518 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.890493 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd" (OuterVolumeSpecName: "kube-api-access-t9fcd") pod "c584b607-9382-4e65-9500-01eb399a17f0" (UID: "c584b607-9382-4e65-9500-01eb399a17f0"). InnerVolumeSpecName "kube-api-access-t9fcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:50:16.890756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.890715 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk" (OuterVolumeSpecName: "kube-api-access-jvlpk") pod "f70f1612-a9ed-48e4-bd8c-200dd4f21d31" (UID: "f70f1612-a9ed-48e4-bd8c-200dd4f21d31"). InnerVolumeSpecName "kube-api-access-jvlpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:50:16.894164 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.894137 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util" (OuterVolumeSpecName: "util") pod "c584b607-9382-4e65-9500-01eb399a17f0" (UID: "c584b607-9382-4e65-9500-01eb399a17f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:16.894394 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.894371 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util" (OuterVolumeSpecName: "util") pod "f70f1612-a9ed-48e4-bd8c-200dd4f21d31" (UID: "f70f1612-a9ed-48e4-bd8c-200dd4f21d31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:16.901984 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.901954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:16.973923 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.973891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:16.988986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.988958 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9fcd\" (UniqueName: \"kubernetes.io/projected/c584b607-9382-4e65-9500-01eb399a17f0-kube-api-access-t9fcd\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.988986 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.988982 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.989176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.988993 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvlpk\" (UniqueName: \"kubernetes.io/projected/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-kube-api-access-jvlpk\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.989176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.989002 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70f1612-a9ed-48e4-bd8c-200dd4f21d31-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.989176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.989009 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:16.989176 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:16.989018 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c584b607-9382-4e65-9500-01eb399a17f0-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:17.697283 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.697209 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" Jul 09 14:50:17.697283 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.697232 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl" event={"ID":"c584b607-9382-4e65-9500-01eb399a17f0","Type":"ContainerDied","Data":"1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf"} Jul 09 14:50:17.697799 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.697281 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a1a6dcfd5dafcf74d4d0bdf89ce7c360f18b9166efb200e74515a74eb6c1dcf" Jul 09 14:50:17.699395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.699175 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" Jul 09 14:50:17.699395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.699206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb" event={"ID":"f70f1612-a9ed-48e4-bd8c-200dd4f21d31","Type":"ContainerDied","Data":"e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c"} Jul 09 14:50:17.699395 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.699247 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e27dcedd2e518549f6274959d669686a7fe6f76c0d550d6bf72697592c88b64c" Jul 09 14:50:17.840349 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.840324 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:17.897937 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.897903 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pplh\" (UniqueName: \"kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh\") pod \"3332bd09-ea20-4f05-9fed-865f1cde29a8\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " Jul 09 14:50:17.898103 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.897947 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util\") pod \"3332bd09-ea20-4f05-9fed-865f1cde29a8\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " Jul 09 14:50:17.898103 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.898014 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle\") pod \"3332bd09-ea20-4f05-9fed-865f1cde29a8\" (UID: \"3332bd09-ea20-4f05-9fed-865f1cde29a8\") " Jul 09 14:50:17.898564 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.898525 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle" (OuterVolumeSpecName: "bundle") pod "3332bd09-ea20-4f05-9fed-865f1cde29a8" (UID: "3332bd09-ea20-4f05-9fed-865f1cde29a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:17.900178 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.900156 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh" (OuterVolumeSpecName: "kube-api-access-5pplh") pod "3332bd09-ea20-4f05-9fed-865f1cde29a8" (UID: "3332bd09-ea20-4f05-9fed-865f1cde29a8"). InnerVolumeSpecName "kube-api-access-5pplh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:50:17.903641 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.903615 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util" (OuterVolumeSpecName: "util") pod "3332bd09-ea20-4f05-9fed-865f1cde29a8" (UID: "3332bd09-ea20-4f05-9fed-865f1cde29a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:50:17.998969 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.998877 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:17.998969 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.998909 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pplh\" (UniqueName: \"kubernetes.io/projected/3332bd09-ea20-4f05-9fed-865f1cde29a8-kube-api-access-5pplh\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:17.998969 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:17.998921 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3332bd09-ea20-4f05-9fed-865f1cde29a8-util\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:50:18.706207 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:18.706175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" event={"ID":"3332bd09-ea20-4f05-9fed-865f1cde29a8","Type":"ContainerDied","Data":"3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742"} Jul 09 14:50:18.706631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:18.706214 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq" Jul 09 14:50:18.706631 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:18.706222 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bedca04f75ff72c194b86a6861344a3ba5f40470f0ff7e0a41cf52391f94742" Jul 09 14:50:20.678042 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:20.678004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:24.407220 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:24.407181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:25.715149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:25.715107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:26.108287 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:26.108254 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:27.033300 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:27.033265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:27.184374 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:27.184328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:27.667198 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:27.667164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:27.788163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:27.788130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:28.962972 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:28.962891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:29.318338 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:29.318303 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:30.891784 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.891746 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b446567f-fjj99"] Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892052 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="util" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892063 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="util" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892072 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="util" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892077 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="util" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892085 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892090 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892100 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892105 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892115 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="pull" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892120 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="pull" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892127 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892132 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892138 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892143 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="extract" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892149 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="pull" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892155 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="pull" Jul 09 14:50:30.892156 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892163 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="util" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892168 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="util" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892174 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="pull" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892178 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="pull" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892185 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="util" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892191 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="util" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892197 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="pull" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892202 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="pull" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892255 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f70f1612-a9ed-48e4-bd8c-200dd4f21d31" containerName="extract" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892262 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fc6073-f4b7-4be2-87df-bba9e04aef4a" containerName="extract" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892270 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3332bd09-ea20-4f05-9fed-865f1cde29a8" containerName="extract" Jul 09 14:50:30.892649 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.892276 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c584b607-9382-4e65-9500-01eb399a17f0" containerName="extract" Jul 09 14:50:30.895182 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.895166 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:30.926668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:30.926637 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b446567f-fjj99"] Jul 09 14:50:31.007865 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.007828 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:31.019974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.019942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.019974 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.019973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-oauth-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.020214 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.020061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-service-ca\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.020214 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.020122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-trusted-ca-bundle\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.020214 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.020185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-oauth-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.020339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.020236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.020339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.020263 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dldbz\" (UniqueName: \"kubernetes.io/projected/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-kube-api-access-dldbz\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121163 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-service-ca\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-trusted-ca-bundle\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-oauth-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121322 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dldbz\" (UniqueName: \"kubernetes.io/projected/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-kube-api-access-dldbz\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121514 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121344 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.121514 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-oauth-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.122008 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.121981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-service-ca\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.122154 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.122102 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-oauth-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.122154 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.122139 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.122371 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.122356 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-trusted-ca-bundle\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.124442 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.124417 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-oauth-config\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.124644 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.124619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-console-serving-cert\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.146963 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.146896 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dldbz\" (UniqueName: \"kubernetes.io/projected/41819f60-d228-4f8a-a3a0-a7cdbe9a9f72-kube-api-access-dldbz\") pod \"console-57b446567f-fjj99\" (UID: \"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72\") " pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.156219 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.156184 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:31.204652 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.204616 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:31.365250 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.365227 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b446567f-fjj99"] Jul 09 14:50:31.367770 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:50:31.367748 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41819f60_d228_4f8a_a3a0_a7cdbe9a9f72.slice/crio-c8ce9387bbea40078feb5ae619cacd63cb139111834cebb404214950a147ee10 WatchSource:0}: Error finding container c8ce9387bbea40078feb5ae619cacd63cb139111834cebb404214950a147ee10: Status 404 returned error can't find the container with id c8ce9387bbea40078feb5ae619cacd63cb139111834cebb404214950a147ee10 Jul 09 14:50:31.776044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.776020 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b446567f-fjj99" event={"ID":"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72","Type":"ContainerStarted","Data":"e4873dc1f0b8294abd652d03ea4b73f39afba730faf5956fe98829f5d3a48fcc"} Jul 09 14:50:31.776186 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.776067 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b446567f-fjj99" event={"ID":"41819f60-d228-4f8a-a3a0-a7cdbe9a9f72","Type":"ContainerStarted","Data":"c8ce9387bbea40078feb5ae619cacd63cb139111834cebb404214950a147ee10"} Jul 09 14:50:31.826188 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:31.826139 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b446567f-fjj99" podStartSLOduration=1.8261247489999999 podStartE2EDuration="1.826124749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:50:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:50:31.825325732 +0000 UTC m=+623.136736342" watchObservedRunningTime="2026-07-09 14:50:31.826124749 +0000 UTC m=+623.137535360" Jul 09 14:50:33.355795 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:33.355757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:35.309588 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:35.309549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:35.471117 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:35.471071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:35.563411 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:35.563324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:41.205548 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:41.205502 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:41.205998 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:41.205612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:41.210499 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:41.210470 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:41.830713 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:41.830684 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b446567f-fjj99" Jul 09 14:50:41.933586 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:41.933551 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:50:42.183121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:42.183039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:42.339026 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:42.338993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:42.568535 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:42.568497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:45.650491 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:45.650453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:45.948290 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:45.948204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:46.164731 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:46.164692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:48.183539 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:48.183495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:48.382767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:48.382708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:52.704510 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:52.704468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:52.794615 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:52.794569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:56.896516 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:56.896475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:50:56.997749 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:50:56.997703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:05.409481 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:05.409439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:05.637260 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:05.637223 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:06.955056 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:06.955016 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-787b54c475-vxg2r" podUID="3b754df7-100e-47ed-b9e4-e610bd906335" containerName="console" containerID="cri-o://e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32" gracePeriod=15 Jul 09 14:51:07.211429 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.211368 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:51:07.247709 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247677 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.247905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247736 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.247905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247813 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.247905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247838 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9w5q\" (UniqueName: \"kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.247905 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247873 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.248140 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247907 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.248140 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.247948 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config\") pod \"3b754df7-100e-47ed-b9e4-e610bd906335\" (UID: \"3b754df7-100e-47ed-b9e4-e610bd906335\") " Jul 09 14:51:07.248248 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.248202 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:51:07.248419 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.248388 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:51:07.248502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.248434 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:51:07.248502 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.248478 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config" (OuterVolumeSpecName: "console-config") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:51:07.250537 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.250489 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q" (OuterVolumeSpecName: "kube-api-access-z9w5q") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "kube-api-access-z9w5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:51:07.250685 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.250662 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:51:07.250942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.250916 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b754df7-100e-47ed-b9e4-e610bd906335" (UID: "3b754df7-100e-47ed-b9e4-e610bd906335"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:51:07.349687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349640 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-console-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349674 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-oauth-config\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349685 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-oauth-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349687 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349694 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b754df7-100e-47ed-b9e4-e610bd906335-console-serving-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349702 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9w5q\" (UniqueName: \"kubernetes.io/projected/3b754df7-100e-47ed-b9e4-e610bd906335-kube-api-access-z9w5q\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349711 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-trusted-ca-bundle\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.349992 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.349741 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b754df7-100e-47ed-b9e4-e610bd906335-service-ca\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 14:51:07.916640 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.916590 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:07.961412 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.961367 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b754df7-100e-47ed-b9e4-e610bd906335" containerID="e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32" exitCode=0 Jul 09 14:51:07.961815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.961441 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787b54c475-vxg2r" Jul 09 14:51:07.961815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.961451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787b54c475-vxg2r" event={"ID":"3b754df7-100e-47ed-b9e4-e610bd906335","Type":"ContainerDied","Data":"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32"} Jul 09 14:51:07.961815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.961533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787b54c475-vxg2r" event={"ID":"3b754df7-100e-47ed-b9e4-e610bd906335","Type":"ContainerDied","Data":"7c09432b846a2ba80914604b141d18c08007da6ede4278eb37e0f6a1b520fc6d"} Jul 09 14:51:07.961815 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.961555 2572 scope.go:117] "RemoveContainer" containerID="e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32" Jul 09 14:51:07.970545 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.970526 2572 scope.go:117] "RemoveContainer" containerID="e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32" Jul 09 14:51:07.970939 ip-10-0-140-95 kubenswrapper[2572]: E0709 14:51:07.970913 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32\": container with ID starting with e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32 not found: ID does not exist" containerID="e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32" Jul 09 14:51:07.971020 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.970949 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32"} err="failed to get container status \"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32\": rpc error: code = NotFound desc = could not find container \"e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32\": container with ID starting with e12081cd80d5ae743dad21f2fb37299b04a1549ec0a0701575b7ec81f9c4de32 not found: ID does not exist" Jul 09 14:51:07.991476 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:07.991430 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:51:08.001595 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:08.001572 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787b54c475-vxg2r"] Jul 09 14:51:08.035464 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:08.035432 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:09.300700 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:09.300665 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b754df7-100e-47ed-b9e4-e610bd906335" path="/var/lib/kubelet/pods/3b754df7-100e-47ed-b9e4-e610bd906335/volumes" Jul 09 14:51:12.604002 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:12.603968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:12.708164 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:12.708116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:15.080233 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:15.080191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:18.177708 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.177674 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7"] Jul 09 14:51:18.178149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.178045 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b754df7-100e-47ed-b9e4-e610bd906335" containerName="console" Jul 09 14:51:18.178149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.178058 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b754df7-100e-47ed-b9e4-e610bd906335" containerName="console" Jul 09 14:51:18.178149 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.178126 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b754df7-100e-47ed-b9e4-e610bd906335" containerName="console" Jul 09 14:51:18.182611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.182591 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.186417 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.186398 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9fp57\"" Jul 09 14:51:18.198110 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.198083 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7"] Jul 09 14:51:18.218045 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.218013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:18.253475 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253656 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253656 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f46522-b1e1-4b1d-80bb-335c21609864-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253656 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253656 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f46522-b1e1-4b1d-80bb-335c21609864-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253656 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zchfk\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-kube-api-access-zchfk\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253854 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253690 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253854 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.253854 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.253742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354311 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354311 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354523 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354523 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354523 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354668 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f46522-b1e1-4b1d-80bb-335c21609864-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354764 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354687 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354763 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f46522-b1e1-4b1d-80bb-335c21609864-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zchfk\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-kube-api-access-zchfk\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354905 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.354942 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.354914 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.355332 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.355308 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f46522-b1e1-4b1d-80bb-335c21609864-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.357055 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.357027 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f46522-b1e1-4b1d-80bb-335c21609864-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.357353 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.357336 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f46522-b1e1-4b1d-80bb-335c21609864-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.363202 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.363172 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.363532 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.363508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zchfk\" (UniqueName: \"kubernetes.io/projected/05f46522-b1e1-4b1d-80bb-335c21609864-kube-api-access-zchfk\") pod \"maas-default-gateway-openshift-default-5df9b4f89-klvl7\" (UID: \"05f46522-b1e1-4b1d-80bb-335c21609864\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.493568 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.493483 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:18.642814 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.642786 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7"] Jul 09 14:51:18.644166 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:51:18.644138 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f46522_b1e1_4b1d_80bb_335c21609864.slice/crio-f1756c0c4c49ef252414567e262d4c1b5cef843c021b516f2397016472dd3fcd WatchSource:0}: Error finding container f1756c0c4c49ef252414567e262d4c1b5cef843c021b516f2397016472dd3fcd: Status 404 returned error can't find the container with id f1756c0c4c49ef252414567e262d4c1b5cef843c021b516f2397016472dd3fcd Jul 09 14:51:18.646069 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.646040 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:51:18.646185 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.646101 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:51:18.646185 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.646132 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:51:18.667005 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:18.666974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:19.020591 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:19.020559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" event={"ID":"05f46522-b1e1-4b1d-80bb-335c21609864","Type":"ContainerStarted","Data":"722ddf907cdf325e7a9d6f4930468c3681ac4d3a0b7fe3f7f4c72d6a7707ce2c"} Jul 09 14:51:19.020790 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:19.020607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" event={"ID":"05f46522-b1e1-4b1d-80bb-335c21609864","Type":"ContainerStarted","Data":"f1756c0c4c49ef252414567e262d4c1b5cef843c021b516f2397016472dd3fcd"} Jul 09 14:51:19.045446 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:19.045393 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" podStartSLOduration=1.045373323 podStartE2EDuration="1.045373323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:51:19.04295569 +0000 UTC m=+670.354366319" watchObservedRunningTime="2026-07-09 14:51:19.045373323 +0000 UTC m=+670.356784002" Jul 09 14:51:19.494398 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:19.494353 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:19.499403 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:19.499379 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:20.025871 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:20.025846 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:20.026756 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:20.026716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:51:20.078767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:20.078708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:20.195767 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:20.195734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:20.337380 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:20.337278 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:21.158538 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:21.158500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:21.286129 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:21.286098 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:41.341881 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:41.341840 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:41.460354 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:41.460317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:41.824368 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:41.824333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:54.402277 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:54.402239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:51:54.533888 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:51:54.533820 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:00.463274 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:00.463182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:00.570957 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:00.570914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:00.639521 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:00.639491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:00.743956 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:00.743856 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:03.316089 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:03.316058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:03.424189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:03.424154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:34.218832 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:34.218792 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:34.614145 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:34.614112 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:34.853387 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:34.853352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:35.056589 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.056558 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:35.162222 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.162190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:35.241868 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.241826 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vzqnz"] Jul 09 14:52:35.245160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.245140 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.249515 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.249497 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tt4ds\"" Jul 09 14:52:35.249611 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.249502 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 14:52:35.255922 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.255896 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vzqnz"] Jul 09 14:52:35.334278 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.334180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrwq\" (UniqueName: \"kubernetes.io/projected/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-kube-api-access-bxrwq\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.334278 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.334241 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.434926 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.434896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrwq\" (UniqueName: \"kubernetes.io/projected/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-kube-api-access-bxrwq\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.435120 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.434952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.435590 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.435572 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-plugins-config-volume\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.453325 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.453290 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrwq\" (UniqueName: \"kubernetes.io/projected/afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9-kube-api-access-bxrwq\") pod \"payload-pre-processing-7964457696-vzqnz\" (UID: \"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9\") " pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.555752 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.555687 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:35.692543 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:35.692516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-vzqnz"] Jul 09 14:52:35.693418 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:52:35.693396 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa0752a_cfa6_4adf_83cd_7d0b36cb3cd9.slice/crio-03d502456d7b043af74d77447720b1f4a81188daaec4c4753fb45650cd97ee64 WatchSource:0}: Error finding container 03d502456d7b043af74d77447720b1f4a81188daaec4c4753fb45650cd97ee64: Status 404 returned error can't find the container with id 03d502456d7b043af74d77447720b1f4a81188daaec4c4753fb45650cd97ee64 Jul 09 14:52:36.426162 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:36.426075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" event={"ID":"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9","Type":"ContainerStarted","Data":"03d502456d7b043af74d77447720b1f4a81188daaec4c4753fb45650cd97ee64"} Jul 09 14:52:37.432887 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:37.432788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" event={"ID":"afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9","Type":"ContainerStarted","Data":"61056b11c79e7d4d47756e7d926a88238b267a09abcb2fcd303a3188f5dad10c"} Jul 09 14:52:37.432887 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:37.432855 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:37.455541 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:37.455488 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" podStartSLOduration=0.970284278 podStartE2EDuration="2.455472998s" totalImagesPullingTime="1.48518872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:52:37.454680396 +0000 UTC m=+748.766091008" watchObservedRunningTime="2026-07-09 14:52:37.455472998 +0000 UTC m=+748.766883608" Jul 09 14:52:43.468134 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.468100 2572 generic.go:356] "Generic (PLEG): container finished" podID="05f46522-b1e1-4b1d-80bb-335c21609864" containerID="722ddf907cdf325e7a9d6f4930468c3681ac4d3a0b7fe3f7f4c72d6a7707ce2c" exitCode=0 Jul 09 14:52:43.468554 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.468168 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" event={"ID":"05f46522-b1e1-4b1d-80bb-335c21609864","Type":"ContainerDied","Data":"722ddf907cdf325e7a9d6f4930468c3681ac4d3a0b7fe3f7f4c72d6a7707ce2c"} Jul 09 14:52:43.468614 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.468560 2572 scope.go:117] "RemoveContainer" containerID="722ddf907cdf325e7a9d6f4930468c3681ac4d3a0b7fe3f7f4c72d6a7707ce2c" Jul 09 14:52:43.469576 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.469550 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:52:43.469663 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.469646 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:52:43.469713 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:43.469699 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 14:52:44.475609 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:44.475574 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" event={"ID":"05f46522-b1e1-4b1d-80bb-335c21609864","Type":"ContainerStarted","Data":"85eac4f746263e780460259b7ea19b1b11ce481e2938c6ca0597fba459768f21"} Jul 09 14:52:44.494310 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:44.494282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:52:44.494612 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:44.494591 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-klvl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 09 14:52:44.494659 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:44.494639 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" podUID="05f46522-b1e1-4b1d-80bb-335c21609864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 09 14:52:45.363314 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:45.363275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:45.457569 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:45.457522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:52:45.493826 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:45.493786 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-klvl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 09 14:52:45.494202 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:45.493852 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" podUID="05f46522-b1e1-4b1d-80bb-335c21609864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 09 14:52:46.494836 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:46.494800 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-klvl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 09 14:52:46.495422 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:46.495389 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" podUID="05f46522-b1e1-4b1d-80bb-335c21609864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 09 14:52:47.494115 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:47.494081 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5df9b4f89-klvl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 09 14:52:47.494306 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:47.494143 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" podUID="05f46522-b1e1-4b1d-80bb-335c21609864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 09 14:52:48.441445 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:48.441416 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-vzqnz" Jul 09 14:52:48.498524 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:48.498489 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:52:48.498781 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:48.498758 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:52:48.499599 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:52:48.499579 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-klvl7" Jul 09 14:53:38.614297 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:38.614210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:53:45.067911 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.067872 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g"] Jul 09 14:53:45.071039 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.071024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.075191 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.075167 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:53:45.075337 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.075244 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:53:45.076829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.076748 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cj4mh\"" Jul 09 14:53:45.076829 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.076791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 14:53:45.086452 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.086426 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g"] Jul 09 14:53:45.111330 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.111298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:53:45.172121 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.172294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.172294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.172294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.172294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.172294 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.172288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frwl\" (UniqueName: \"kubernetes.io/projected/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-kube-api-access-6frwl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273183 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273360 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273360 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273360 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273360 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273360 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frwl\" (UniqueName: \"kubernetes.io/projected/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-kube-api-access-6frwl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273600 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273559 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273662 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273634 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.273794 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.273775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.275660 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.275643 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.275931 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.275916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.283530 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.283503 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frwl\" (UniqueName: \"kubernetes.io/projected/1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe-kube-api-access-6frwl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pj92g\" (UID: \"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.381487 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.381404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:45.520031 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.519998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g"] Jul 09 14:53:45.521467 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:53:45.521445 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce1ce58_5b5b_49fc_b30c_62f8499ccfbe.slice/crio-9e4b0cbe1a8b4909e625044af25c7a6b61355f37cf23a50909b1c08299564e15 WatchSource:0}: Error finding container 9e4b0cbe1a8b4909e625044af25c7a6b61355f37cf23a50909b1c08299564e15: Status 404 returned error can't find the container with id 9e4b0cbe1a8b4909e625044af25c7a6b61355f37cf23a50909b1c08299564e15 Jul 09 14:53:45.792522 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:45.792486 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" event={"ID":"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe","Type":"ContainerStarted","Data":"9e4b0cbe1a8b4909e625044af25c7a6b61355f37cf23a50909b1c08299564e15"} Jul 09 14:53:46.799608 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:46.799570 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" event={"ID":"1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe","Type":"ContainerStarted","Data":"a27520357dacd64c6fab5da25bd646f1062b2c85cfeff0de39e8cc26c588dc23"} Jul 09 14:53:46.820179 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:46.820120 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" podStartSLOduration=0.724559988 podStartE2EDuration="1.820105337s" totalImagesPullingTime="1.095545349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:53:46.817928581 +0000 UTC m=+818.129339195" watchObservedRunningTime="2026-07-09 14:53:46.820105337 +0000 UTC m=+818.131515947" Jul 09 14:53:55.382022 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:55.381968 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:55.382476 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:55.382053 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:55.394789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:55.394762 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:53:55.857948 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:53:55.857923 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pj92g" Jul 09 14:54:01.496186 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:01.496142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:54:14.204051 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:14.204011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:54:30.974826 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:30.974791 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb"] Jul 09 14:54:30.980683 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:30.980664 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:30.984035 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:30.984018 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 14:54:30.989334 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:30.989309 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb"] Jul 09 14:54:31.065339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.065339 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065340 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.065549 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d369ce1f-b913-4a74-8824-626d3863621f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.065549 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.065549 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84mlj\" (UniqueName: \"kubernetes.io/projected/d369ce1f-b913-4a74-8824-626d3863621f-kube-api-access-84mlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.065646 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.065555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.067236 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.067209 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:54:31.166160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166160 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166177 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d369ce1f-b913-4a74-8824-626d3863621f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84mlj\" (UniqueName: \"kubernetes.io/projected/d369ce1f-b913-4a74-8824-626d3863621f-kube-api-access-84mlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166409 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166666 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166641 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166765 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166653 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.166765 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.166699 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.168636 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.168611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d369ce1f-b913-4a74-8824-626d3863621f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.168789 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.168770 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d369ce1f-b913-4a74-8824-626d3863621f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.175273 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.175248 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84mlj\" (UniqueName: \"kubernetes.io/projected/d369ce1f-b913-4a74-8824-626d3863621f-kube-api-access-84mlj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-87zrb\" (UID: \"d369ce1f-b913-4a74-8824-626d3863621f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.291471 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.291433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:31.436046 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:31.435974 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb"] Jul 09 14:54:31.441709 ip-10-0-140-95 kubenswrapper[2572]: W0709 14:54:31.441674 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd369ce1f_b913_4a74_8824_626d3863621f.slice/crio-b904085b15b00a4494cfd505622e3edc4903b558318d566a4778471eda335a13 WatchSource:0}: Error finding container b904085b15b00a4494cfd505622e3edc4903b558318d566a4778471eda335a13: Status 404 returned error can't find the container with id b904085b15b00a4494cfd505622e3edc4903b558318d566a4778471eda335a13 Jul 09 14:54:32.043331 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:32.043293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" event={"ID":"d369ce1f-b913-4a74-8824-626d3863621f","Type":"ContainerStarted","Data":"6bea7b1510bd01388f36bd7b22923d315e0ebaa64b4f9ea2d00949efec2e6823"} Jul 09 14:54:32.043714 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:32.043347 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" event={"ID":"d369ce1f-b913-4a74-8824-626d3863621f","Type":"ContainerStarted","Data":"b904085b15b00a4494cfd505622e3edc4903b558318d566a4778471eda335a13"} Jul 09 14:54:32.063165 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:32.063107 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" podStartSLOduration=1.832029183 podStartE2EDuration="2.063089886s" totalImagesPullingTime="231.060703ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:54:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:54:32.060867895 +0000 UTC m=+863.372278519" watchObservedRunningTime="2026-07-09 14:54:32.063089886 +0000 UTC m=+863.374500497" Jul 09 14:54:41.291884 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:41.291840 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:41.291884 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:41.291896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:41.304562 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:41.304537 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:42.108480 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:42.108452 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-87zrb" Jul 09 14:54:46.799090 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:46.799038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:54:58.431885 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:58.431853 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:54:58.491617 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:54:58.491589 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:55:09.189827 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:09.189799 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:55:09.190301 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:09.189939 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 14:55:09.191764 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:09.191744 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:55:09.192044 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:09.192030 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 14:55:28.409259 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:28.409227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:55:28.522570 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:28.522532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:55:38.031803 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:38.031752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:55:42.298847 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:42.298801 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:55:42.395069 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:55:42.395035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:56:00.320278 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:56:00.320231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:56:00.419234 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:56:00.419186 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:56:01.522559 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:56:01.522486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:56:01.612510 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:56:01.612476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:56:37.022212 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:56:37.022084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:57:13.659005 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:57:13.658966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:57:13.718175 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:57:13.718138 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:57:26.897189 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:57:26.897130 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:57:28.276807 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:57:28.276760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:12.084172 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:12.084000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:12.234206 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:12.234173 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:12.616117 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:12.616084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:13.181890 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:13.181852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:18.851848 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:18.851813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:19.003500 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:19.003460 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:19.225810 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:19.225685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:19.381979 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:19.381934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:25.241253 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:25.241216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:58:25.321938 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:58:25.321896 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:59:17.512490 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:59:17.512442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 14:59:17.579058 ip-10-0-140-95 kubenswrapper[2572]: I0709 14:59:17.579005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:00:09.225075 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:00:09.225048 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:00:09.225780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:00:09.225135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:00:09.227491 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:00:09.227469 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:00:09.227618 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:00:09.227523 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:01:59.846569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:01:59.846523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:02:04.595052 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:02:04.595014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:02:40.620328 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:02:40.620293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:03:42.641632 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:03:42.641596 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:05:09.260979 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:09.260950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:05:09.262556 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:09.262531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:05:09.263438 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:09.263414 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:05:09.264946 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:09.264927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:05:11.137079 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:11.137021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:05:11.202895 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:05:11.202861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:06:29.829517 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:06:29.829483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:06:29.885679 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:06:29.885648 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:02.424991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:02.424955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:04.811635 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:04.811600 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:08.362880 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.362849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:08.461756 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.461701 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:08.651393 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.651309 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:08.657025 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.656985 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.660131 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.660104 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4d23c1d4-openshift-default-dockercfg-skqjs\"" Jul 09 15:09:08.670568 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.670545 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:08.677570 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.677538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:08.759380 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.759338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:08.763504 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763616 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfbfw\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763616 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763616 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763573 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763765 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763765 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.763830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.763828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.864861 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.864819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865029 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.864872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865029 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.864988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfbfw\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865102 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865102 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865170 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865148 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865226 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865226 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865295 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865295 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865389 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865366 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865610 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865583 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865683 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.865683 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.865626 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.867521 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.867491 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.867794 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.867777 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.880319 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.880296 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfbfw\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.883666 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.883641 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token\") pod \"e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:08.969163 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:08.969077 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:09.107823 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.107790 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:09.108772 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:09:09.108742 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e6249f_393c_49b8_a92a_37290c88688f.slice/crio-ac04240116a0dd29d16d5a88ad42109ed26c972605b3291ddf4c3bbb3f5f8e18 WatchSource:0}: Error finding container ac04240116a0dd29d16d5a88ad42109ed26c972605b3291ddf4c3bbb3f5f8e18: Status 404 returned error can't find the container with id ac04240116a0dd29d16d5a88ad42109ed26c972605b3291ddf4c3bbb3f5f8e18 Jul 09 15:09:09.111058 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.111026 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:09.111130 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.111112 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:09.111167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.111154 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:09.666307 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.666278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" event={"ID":"93e6249f-393c-49b8-a92a-37290c88688f","Type":"ContainerStarted","Data":"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c"} Jul 09 15:09:09.666689 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.666327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" event={"ID":"93e6249f-393c-49b8-a92a-37290c88688f","Type":"ContainerStarted","Data":"ac04240116a0dd29d16d5a88ad42109ed26c972605b3291ddf4c3bbb3f5f8e18"} Jul 09 15:09:09.689803 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.689747 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" podStartSLOduration=1.689706004 podStartE2EDuration="1.689706004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:09:09.689114905 +0000 UTC m=+1741.000525516" watchObservedRunningTime="2026-07-09 15:09:09.689706004 +0000 UTC m=+1741.001116615" Jul 09 15:09:09.969807 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:09.969701 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:10.056103 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:10.056071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:10.156650 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:10.156620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:10.370444 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:10.370407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:10.470084 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:10.470052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:10.974296 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:10.974265 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:11.677205 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:11.677174 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:11.678132 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:11.678114 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:11.728341 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:11.728307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:12.271572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:12.271539 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:12.651248 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:12.651198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:12.752783 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:12.752628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:15.163688 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.163641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:15.334252 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.334214 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:15.334487 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.334457 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" podUID="93e6249f-393c-49b8-a92a-37290c88688f" containerName="istio-proxy" containerID="cri-o://d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c" gracePeriod=30 Jul 09 15:09:15.351341 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.351314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:15.469264 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.469177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:15.734744 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:15.734650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:16.926335 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:16.926306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:20.995765 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:20.995739 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:21.080762 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080639 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080762 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080710 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080790 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080870 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfbfw\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080896 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.080991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.080927 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.081315 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081020 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:21.081315 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081131 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:21.081315 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081226 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket\") pod \"93e6249f-393c-49b8-a92a-37290c88688f\" (UID: \"93e6249f-393c-49b8-a92a-37290c88688f\") " Jul 09 15:09:21.081315 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081249 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:09:21.081575 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081480 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data" (OuterVolumeSpecName: "istio-data") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:21.081575 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081535 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:21.081884 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081863 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.081957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081890 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.081957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081905 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e6249f-393c-49b8-a92a-37290c88688f-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.081957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081918 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.081957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.081932 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.083362 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.083341 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw" (OuterVolumeSpecName: "kube-api-access-mfbfw") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "kube-api-access-mfbfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:21.083420 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.083385 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token" (OuterVolumeSpecName: "istio-token") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:21.083615 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.083592 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:21.083692 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.083645 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93e6249f-393c-49b8-a92a-37290c88688f" (UID: "93e6249f-393c-49b8-a92a-37290c88688f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:09:21.183308 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.183271 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfbfw\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-kube-api-access-mfbfw\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.183308 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.183303 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e6249f-393c-49b8-a92a-37290c88688f-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.183308 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.183313 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e6249f-393c-49b8-a92a-37290c88688f-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.183546 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.183321 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e6249f-393c-49b8-a92a-37290c88688f-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:21.252915 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.252887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:21.316527 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.316488 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:21.442778 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.442690 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:21.443128 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.443111 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e6249f-393c-49b8-a92a-37290c88688f" containerName="istio-proxy" Jul 09 15:09:21.443128 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.443130 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e6249f-393c-49b8-a92a-37290c88688f" containerName="istio-proxy" Jul 09 15:09:21.443256 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.443199 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e6249f-393c-49b8-a92a-37290c88688f" containerName="istio-proxy" Jul 09 15:09:21.446466 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.446447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.449305 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.449290 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c4673fb2-openshift-default-dockercfg-wvhrn\"" Jul 09 15:09:21.458308 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.458284 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:21.478167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.478145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:21.486297 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486267 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486416 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486416 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486542 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486542 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486542 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8jzx\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486542 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486532 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.486780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.486612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.579917 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.579876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:21.588020 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.587989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588333 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588333 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588222 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8jzx\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588533 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588461 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588533 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588512 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588634 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588546 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588634 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588802 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588791 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.588941 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.588915 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.590388 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.590369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.590908 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.590890 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.597444 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.597415 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.597614 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.597598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8jzx\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx\") pod \"e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.754452 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.754369 2572 generic.go:356] "Generic (PLEG): container finished" podID="93e6249f-393c-49b8-a92a-37290c88688f" containerID="d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c" exitCode=0 Jul 09 15:09:21.754452 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.754416 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" Jul 09 15:09:21.754633 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.754443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" event={"ID":"93e6249f-393c-49b8-a92a-37290c88688f","Type":"ContainerDied","Data":"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c"} Jul 09 15:09:21.754633 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.754495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx" event={"ID":"93e6249f-393c-49b8-a92a-37290c88688f","Type":"ContainerDied","Data":"ac04240116a0dd29d16d5a88ad42109ed26c972605b3291ddf4c3bbb3f5f8e18"} Jul 09 15:09:21.754633 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.754516 2572 scope.go:117] "RemoveContainer" containerID="d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c" Jul 09 15:09:21.758024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.758006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:21.763667 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.763650 2572 scope.go:117] "RemoveContainer" containerID="d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c" Jul 09 15:09:21.763963 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:09:21.763944 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c\": container with ID starting with d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c not found: ID does not exist" containerID="d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c" Jul 09 15:09:21.764047 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.763970 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c"} err="failed to get container status \"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c\": rpc error: code = NotFound desc = could not find container \"d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c\": container with ID starting with d9d3726e1a4310f651e6b6425f381957e0528b70e839e1d6c3b37bfccb6f9b6c not found: ID does not exist" Jul 09 15:09:21.777849 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.777820 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:21.782138 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.782113 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4d23c1d4-openshift-default-864f785cdf-qxzzx"] Jul 09 15:09:21.901563 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.901533 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:21.903444 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:09:21.903417 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b801bd_e87b_4412_bafd_6ad1155aa31d.slice/crio-87d77df52300ab6f8a5e838e26b7cfaec1ec89868717f6f94b85fb1fa6e10f62 WatchSource:0}: Error finding container 87d77df52300ab6f8a5e838e26b7cfaec1ec89868717f6f94b85fb1fa6e10f62: Status 404 returned error can't find the container with id 87d77df52300ab6f8a5e838e26b7cfaec1ec89868717f6f94b85fb1fa6e10f62 Jul 09 15:09:21.905862 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.905824 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:21.905930 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.905895 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:21.905930 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:21.905922 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:22.558594 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:22.558556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:22.648825 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:22.648786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:22.762426 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:22.762393 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" event={"ID":"05b801bd-e87b-4412-bafd-6ad1155aa31d","Type":"ContainerStarted","Data":"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1"} Jul 09 15:09:22.762572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:22.762442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" event={"ID":"05b801bd-e87b-4412-bafd-6ad1155aa31d","Type":"ContainerStarted","Data":"87d77df52300ab6f8a5e838e26b7cfaec1ec89868717f6f94b85fb1fa6e10f62"} Jul 09 15:09:22.786743 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:22.786673 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" podStartSLOduration=1.7866585499999998 podStartE2EDuration="1.78665855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:09:22.784663821 +0000 UTC m=+1754.096074450" watchObservedRunningTime="2026-07-09 15:09:22.78665855 +0000 UTC m=+1754.098069160" Jul 09 15:09:23.023174 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.023147 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:23.136313 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.136283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:23.301069 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.300990 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e6249f-393c-49b8-a92a-37290c88688f" path="/var/lib/kubelet/pods/93e6249f-393c-49b8-a92a-37290c88688f/volumes" Jul 09 15:09:23.309755 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.309708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:23.759307 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.759220 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:23.764415 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.764387 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:23.767776 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.767752 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:23.768455 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:23.768434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:24.481005 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:24.480971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:27.783542 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:27.783501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:28.064885 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:28.064800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:28.924784 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:28.924746 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:28.925173 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:28.924960 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" podUID="05b801bd-e87b-4412-bafd-6ad1155aa31d" containerName="istio-proxy" containerID="cri-o://327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1" gracePeriod=30 Jul 09 15:09:29.145463 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:29.145429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:29.246199 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:29.246113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:31.105127 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:31.105085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:34.173370 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.173342 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:34.303275 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303240 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303287 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303314 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303374 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303395 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303423 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303468 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303447 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8jzx\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303484 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token\") pod \"05b801bd-e87b-4412-bafd-6ad1155aa31d\" (UID: \"05b801bd-e87b-4412-bafd-6ad1155aa31d\") " Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303545 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303604 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303780 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data" (OuterVolumeSpecName: "istio-data") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:34.303812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303793 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:34.304083 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303920 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.304083 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303943 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.304083 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303957 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.304083 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303958 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:09:34.304083 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.303969 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.305937 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.305914 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token" (OuterVolumeSpecName: "istio-token") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:34.306049 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.305958 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx" (OuterVolumeSpecName: "kube-api-access-z8jzx") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "kube-api-access-z8jzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:34.306049 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.306020 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:34.306122 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.306051 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05b801bd-e87b-4412-bafd-6ad1155aa31d" (UID: "05b801bd-e87b-4412-bafd-6ad1155aa31d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:09:34.405230 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.405195 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.405230 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.405227 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.405230 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.405239 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8jzx\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-kube-api-access-z8jzx\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.405469 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.405251 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05b801bd-e87b-4412-bafd-6ad1155aa31d-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.405469 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.405262 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05b801bd-e87b-4412-bafd-6ad1155aa31d-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:34.696714 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.696635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:34.797873 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.797832 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:34.824426 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.824392 2572 generic.go:356] "Generic (PLEG): container finished" podID="05b801bd-e87b-4412-bafd-6ad1155aa31d" containerID="327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1" exitCode=0 Jul 09 15:09:34.824558 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.824442 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" Jul 09 15:09:34.824558 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.824470 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" event={"ID":"05b801bd-e87b-4412-bafd-6ad1155aa31d","Type":"ContainerDied","Data":"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1"} Jul 09 15:09:34.824558 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.824529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg" event={"ID":"05b801bd-e87b-4412-bafd-6ad1155aa31d","Type":"ContainerDied","Data":"87d77df52300ab6f8a5e838e26b7cfaec1ec89868717f6f94b85fb1fa6e10f62"} Jul 09 15:09:34.824668 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.824561 2572 scope.go:117] "RemoveContainer" containerID="327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1" Jul 09 15:09:34.835090 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.835074 2572 scope.go:117] "RemoveContainer" containerID="327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1" Jul 09 15:09:34.835364 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:09:34.835346 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1\": container with ID starting with 327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1 not found: ID does not exist" containerID="327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1" Jul 09 15:09:34.835415 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.835373 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1"} err="failed to get container status \"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1\": rpc error: code = NotFound desc = could not find container \"327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1\": container with ID starting with 327e81178297057b3698d7be92f04282b814205e5ffa91cf4c889fee08babdf1 not found: ID does not exist" Jul 09 15:09:34.848288 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.848262 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:34.855043 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.855021 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c4673fb2-openshift-default-856db49fbf-xpvkg"] Jul 09 15:09:34.883397 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.883363 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:34.883795 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.883779 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05b801bd-e87b-4412-bafd-6ad1155aa31d" containerName="istio-proxy" Jul 09 15:09:34.883841 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.883797 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05b801bd-e87b-4412-bafd-6ad1155aa31d" containerName="istio-proxy" Jul 09 15:09:34.883873 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.883865 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="05b801bd-e87b-4412-bafd-6ad1155aa31d" containerName="istio-proxy" Jul 09 15:09:34.886699 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.886684 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:34.890365 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.890346 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-370fdbe4-openshift-default-dockercfg-dqrp6\"" Jul 09 15:09:34.932470 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.932439 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:34.952897 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:34.952822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:35.011280 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011244 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011741 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011580 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011741 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011741 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011741 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97q58\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.011741 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.012050 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.012050 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.011819 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.073730 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.073677 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:35.113087 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113221 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97q58\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113285 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113497 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113523 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.113921 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.113895 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.114175 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.114156 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.114275 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.114258 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.115856 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.115833 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.115943 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.115894 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.121866 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.121835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.121984 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.121918 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97q58\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58\") pod \"e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.197999 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.197947 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:35.302805 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.302769 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05b801bd-e87b-4412-bafd-6ad1155aa31d" path="/var/lib/kubelet/pods/05b801bd-e87b-4412-bafd-6ad1155aa31d/volumes" Jul 09 15:09:35.344868 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.344846 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:35.346658 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:09:35.346631 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e08bea_8a74_43a8_93b5_46ed1ab81fd6.slice/crio-f8a5dd907dca5028fc6d8a5969057e2ec419c6abae0c4c07a78b3b751070ade5 WatchSource:0}: Error finding container f8a5dd907dca5028fc6d8a5969057e2ec419c6abae0c4c07a78b3b751070ade5: Status 404 returned error can't find the container with id f8a5dd907dca5028fc6d8a5969057e2ec419c6abae0c4c07a78b3b751070ade5 Jul 09 15:09:35.349343 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.349314 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:35.349413 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.349375 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:35.349448 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.349421 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:09:35.832627 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.832593 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" event={"ID":"64e08bea-8a74-43a8-93b5-46ed1ab81fd6","Type":"ContainerStarted","Data":"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb"} Jul 09 15:09:35.832959 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.832651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" event={"ID":"64e08bea-8a74-43a8-93b5-46ed1ab81fd6","Type":"ContainerStarted","Data":"f8a5dd907dca5028fc6d8a5969057e2ec419c6abae0c4c07a78b3b751070ade5"} Jul 09 15:09:35.853015 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:35.852966 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" podStartSLOduration=1.852948912 podStartE2EDuration="1.852948912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:09:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:09:35.851485798 +0000 UTC m=+1767.162896423" watchObservedRunningTime="2026-07-09 15:09:35.852948912 +0000 UTC m=+1767.164359523" Jul 09 15:09:36.124097 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.124014 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:36.198193 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.198150 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:36.202899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.202877 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:36.215700 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.215672 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:36.277224 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.277195 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:36.645513 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.645484 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:36.745804 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.745776 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:36.846604 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.846570 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:36.847650 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:36.847629 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:38.316598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:38.316564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:40.533330 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.533300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:40.692064 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.692028 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:40.692246 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.692224 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" podUID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" containerName="istio-proxy" containerID="cri-o://48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb" gracePeriod=30 Jul 09 15:09:40.746887 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.746854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:40.863514 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.863434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:40.932338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:40.932305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:42.337081 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:42.337058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:46.641043 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.641013 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:46.823511 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823477 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823511 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823517 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823537 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97q58\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823563 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823579 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823615 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823660 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823692 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.823789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.823762 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo\") pod \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\" (UID: \"64e08bea-8a74-43a8-93b5-46ed1ab81fd6\") " Jul 09 15:09:46.824151 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824019 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:46.824151 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824024 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:09:46.824151 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824135 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:46.824359 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824157 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.824359 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824270 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.824359 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824209 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:46.825024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.824995 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:46.826034 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.825999 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58" (OuterVolumeSpecName: "kube-api-access-97q58") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "kube-api-access-97q58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:46.826145 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.826032 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:09:46.826145 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.826031 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:09:46.826220 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.826159 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64e08bea-8a74-43a8-93b5-46ed1ab81fd6" (UID: "64e08bea-8a74-43a8-93b5-46ed1ab81fd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:09:46.902303 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.902271 2572 generic.go:356] "Generic (PLEG): container finished" podID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" containerID="48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb" exitCode=0 Jul 09 15:09:46.902571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.902321 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" Jul 09 15:09:46.902571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.902357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" event={"ID":"64e08bea-8a74-43a8-93b5-46ed1ab81fd6","Type":"ContainerDied","Data":"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb"} Jul 09 15:09:46.902571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.902416 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls" event={"ID":"64e08bea-8a74-43a8-93b5-46ed1ab81fd6","Type":"ContainerDied","Data":"f8a5dd907dca5028fc6d8a5969057e2ec419c6abae0c4c07a78b3b751070ade5"} Jul 09 15:09:46.902571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.902446 2572 scope.go:117] "RemoveContainer" containerID="48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb" Jul 09 15:09:46.914882 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.914862 2572 scope.go:117] "RemoveContainer" containerID="48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb" Jul 09 15:09:46.915177 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:09:46.915150 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb\": container with ID starting with 48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb not found: ID does not exist" containerID="48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb" Jul 09 15:09:46.915269 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.915190 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb"} err="failed to get container status \"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb\": rpc error: code = NotFound desc = could not find container \"48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb\": container with ID starting with 48ba8415cadd7c83e162693d25eeba36d68f78394536bf50868a459f3e5962fb not found: ID does not exist" Jul 09 15:09:46.925139 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925114 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925143 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925158 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925172 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925184 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925199 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97q58\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-kube-api-access-97q58\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.925241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.925211 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64e08bea-8a74-43a8-93b5-46ed1ab81fd6-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:09:46.927275 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.927253 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:46.930672 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.930653 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-370fdbe4-openshift-default-77f9dcdccf-q68ls"] Jul 09 15:09:46.988536 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:46.988504 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:47.075473 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:47.075400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:47.301216 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:47.301186 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" path="/var/lib/kubelet/pods/64e08bea-8a74-43a8-93b5-46ed1ab81fd6/volumes" Jul 09 15:09:47.475647 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:47.475557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:47.576559 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:47.576529 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:47.675170 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:47.675139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:49.191445 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:49.191416 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:54.952431 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:54.952400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:55.061810 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:55.061779 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:55.153039 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:55.153005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:55.255898 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:55.255815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:09:55.697379 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:09:55.697347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:09.304590 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:09.304562 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:10:09.306867 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:09.306846 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:10:09.307009 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:09.306945 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:10:09.309318 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:09.309298 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:10:21.687027 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:21.686987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:27.553668 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:27.553625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:27.657496 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:27.657464 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:27.755001 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:27.754963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:43.610065 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:43.610029 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:49.470045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:49.470000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:49.536219 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:49.536181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:10:49.692815 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:10:49.692778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:00.191757 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:00.191678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:01.005817 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:01.005772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:06.696306 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:06.696261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:06.763509 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:06.763474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:06.851530 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:06.851496 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:06.942888 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:06.942854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:07.042607 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:07.042579 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:07.761163 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:07.761116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:07.868710 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:07.868676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:07.967374 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:07.967331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:09.614902 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:09.614861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:15.532061 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:15.532003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:15.595119 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:15.595083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:16.198939 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:16.198904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:22.251235 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.251205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:22.318900 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.318847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:22.500447 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.500411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:22.799937 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.799903 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:22.800415 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.800398 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" containerName="istio-proxy" Jul 09 15:11:22.800465 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.800418 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" containerName="istio-proxy" Jul 09 15:11:22.800501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.800493 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e08bea-8a74-43a8-93b5-46ed1ab81fd6" containerName="istio-proxy" Jul 09 15:11:22.803487 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.803470 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.806655 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.806638 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-93979c25-openshift-default-dockercfg-qsd79\"" Jul 09 15:11:22.828369 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.828332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:22.828546 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.828378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:22.994401 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994572 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994680 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994680 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994680 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994807 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994702 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:22.994807 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:22.994746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhd7\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.095944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.095980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhd7\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096252 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096252 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096252 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096102 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096252 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096523 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096497 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096690 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096690 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096690 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096579 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096917 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096791 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.096917 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.096843 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.097262 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.097238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.098538 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.098515 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.098792 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.098775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.105695 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.105668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.106144 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.106120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhd7\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7\") pod \"e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.113877 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.113859 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:23.118441 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.118419 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:23.260814 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.260788 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:23.261986 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:11:23.261956 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aa643f_b1ba_4663_9394_94689fd1a08d.slice/crio-5eb832b7af9dc42558c4ec613b1868fb3e7a2645c8320b968fe022c1b1f0e5d5 WatchSource:0}: Error finding container 5eb832b7af9dc42558c4ec613b1868fb3e7a2645c8320b968fe022c1b1f0e5d5: Status 404 returned error can't find the container with id 5eb832b7af9dc42558c4ec613b1868fb3e7a2645c8320b968fe022c1b1f0e5d5 Jul 09 15:11:23.264325 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.264297 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:23.264418 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.264363 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:23.264418 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.264392 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:23.423639 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.423538 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerStarted","Data":"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd"} Jul 09 15:11:23.423639 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.423592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerStarted","Data":"5eb832b7af9dc42558c4ec613b1868fb3e7a2645c8320b968fe022c1b1f0e5d5"} Jul 09 15:11:23.448990 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:23.448938 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" podStartSLOduration=1.448921705 podStartE2EDuration="1.448921705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:11:23.44835941 +0000 UTC m=+1874.759770047" watchObservedRunningTime="2026-07-09 15:11:23.448921705 +0000 UTC m=+1874.760332315" Jul 09 15:11:24.046171 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:24.046135 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:24.114304 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:24.114275 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:24.119046 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:24.119021 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:24.430116 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:24.430032 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:24.431134 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:24.431115 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:25.689658 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:25.689624 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:25.786803 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:25.786770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:25.958378 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:25.958289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:26.208913 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:26.208833 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:26.433504 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:26.433476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:26.541589 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:26.541562 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:30.196684 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:30.196606 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:30.856986 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:30.856953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:30.955910 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:30.955878 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:31.276904 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:31.276877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:37.010241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:37.010206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:37.111495 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:37.111458 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:37.425338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:37.425300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:37.841501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:37.841462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:38.480991 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:38.480951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:40.471915 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:40.471866 2572 patch_prober.go:28] interesting pod/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 15:11:40.472417 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:40.471948 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 15:11:41.527318 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.527284 2572 generic.go:356] "Generic (PLEG): container finished" podID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerID="cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd" exitCode=0 Jul 09 15:11:41.527795 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.527361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerDied","Data":"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd"} Jul 09 15:11:41.527883 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.527797 2572 scope.go:117] "RemoveContainer" containerID="cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd" Jul 09 15:11:41.528855 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.528827 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:41.528953 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.528897 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:41.528953 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:41.528928 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:11:42.534514 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:42.534480 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerStarted","Data":"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870"} Jul 09 15:11:43.114325 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.114291 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:43.117735 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.117693 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:43.501977 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.501898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:43.539674 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.539647 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:43.540644 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.540624 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:43.602418 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.602370 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:43.762769 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.762658 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:43.780476 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:43.780439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:44.144664 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:44.144632 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:44.246247 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:44.246215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:44.381240 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:44.381188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:44.544996 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:44.544964 2572 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" secret="" err="secret \"e2e-mt-93979c25-openshift-default-dockercfg-qsd79\" not found" Jul 09 15:11:45.550123 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:45.550077 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" containerID="cri-o://adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870" gracePeriod=30 Jul 09 15:11:50.013969 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.013918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:50.119100 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.119063 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:50.430901 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.430870 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:50.524870 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.524836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:50.825625 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.825599 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:50.963351 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963314 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swhd7\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963351 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963359 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963413 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963465 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963541 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963569 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963564 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963852 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963596 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963852 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963631 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data\") pod \"d5aa643f-b1ba-4663-9394-94689fd1a08d\" (UID: \"d5aa643f-b1ba-4663-9394-94689fd1a08d\") " Jul 09 15:11:50.963852 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963785 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:11:50.963852 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963800 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:11:50.964069 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963987 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:50.964069 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.963998 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:11:50.964069 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.964009 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:50.964225 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.964173 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:11:50.964525 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.964499 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:11:50.966062 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.966031 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:11:50.966158 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.966074 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:11:50.966314 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.966290 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7" (OuterVolumeSpecName: "kube-api-access-swhd7") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "kube-api-access-swhd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:11:50.966314 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:50.966301 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5aa643f-b1ba-4663-9394-94689fd1a08d" (UID: "d5aa643f-b1ba-4663-9394-94689fd1a08d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:11:51.064779 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064715 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhd7\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-kube-api-access-swhd7\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.064779 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064774 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.064779 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064784 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.064779 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064792 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5aa643f-b1ba-4663-9394-94689fd1a08d-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.065301 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064800 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.065301 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064808 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.065301 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.064816 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5aa643f-b1ba-4663-9394-94689fd1a08d-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:11:51.583045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.582959 2572 generic.go:356] "Generic (PLEG): container finished" podID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerID="adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870" exitCode=0 Jul 09 15:11:51.583045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.583027 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" Jul 09 15:11:51.583229 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.583049 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerDied","Data":"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870"} Jul 09 15:11:51.583229 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.583113 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6" event={"ID":"d5aa643f-b1ba-4663-9394-94689fd1a08d","Type":"ContainerDied","Data":"5eb832b7af9dc42558c4ec613b1868fb3e7a2645c8320b968fe022c1b1f0e5d5"} Jul 09 15:11:51.583229 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.583140 2572 scope.go:117] "RemoveContainer" containerID="adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870" Jul 09 15:11:51.592433 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.592416 2572 scope.go:117] "RemoveContainer" containerID="cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd" Jul 09 15:11:51.600526 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.600505 2572 scope.go:117] "RemoveContainer" containerID="adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870" Jul 09 15:11:51.600796 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:11:51.600776 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870\": container with ID starting with adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870 not found: ID does not exist" containerID="adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870" Jul 09 15:11:51.600850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.600807 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870"} err="failed to get container status \"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870\": rpc error: code = NotFound desc = could not find container \"adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870\": container with ID starting with adc20748cf8291ef6ae6fa877a71991acdba72df0bb4ceed3c786c04dc25c870 not found: ID does not exist" Jul 09 15:11:51.600850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.600824 2572 scope.go:117] "RemoveContainer" containerID="cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd" Jul 09 15:11:51.601049 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:11:51.601032 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd\": container with ID starting with cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd not found: ID does not exist" containerID="cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd" Jul 09 15:11:51.601092 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.601055 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd"} err="failed to get container status \"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd\": rpc error: code = NotFound desc = could not find container \"cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd\": container with ID starting with cd130c7603dae67a2a37559e7967231bbecef8a5b9400cb2b8966f366f02e3cd not found: ID does not exist" Jul 09 15:11:51.614344 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.614315 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:51.618803 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:51.618783 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-93979c25-openshift-default-5d54c67cb7-nggh6"] Jul 09 15:11:53.300360 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:53.300325 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" path="/var/lib/kubelet/pods/d5aa643f-b1ba-4663-9394-94689fd1a08d/volumes" Jul 09 15:11:55.965946 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:55.965906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:11:56.026933 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:11:56.026901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:02.795981 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:02.795942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:03.073075 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.072984 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:12:03.073375 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.073362 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:12:03.073422 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.073378 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:12:03.073422 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.073397 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:12:03.073422 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.073402 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:12:03.073518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.073459 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:12:03.078155 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.078128 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.081043 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.081023 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-56796089-openshift-default-dockercfg-stgks\"" Jul 09 15:12:03.089587 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.089561 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:12:03.101851 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.101819 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:03.172984 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.172949 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173168 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173231 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173160 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173231 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqwx\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173343 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173402 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173449 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173420 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173498 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.173541 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.173516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274658 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274658 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274668 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274785 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqwx\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274840 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.274914 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275238 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.274951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275238 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.275076 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275238 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.275224 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275431 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.275379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275431 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.275404 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.275505 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.275463 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.277241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.277217 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.277452 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.277434 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.283541 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.283520 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.283906 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.283880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqwx\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx\") pod \"e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.390576 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.390481 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:03.530038 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.530004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:03.537767 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.537741 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:12:03.539311 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:12:03.539275 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708c7a03_f892_4c87_bf35_7278abf113ff.slice/crio-954c518ff338c3f8c80e3731ef9fade2d59ae50b8b5d86ff06891bb46f2a9520 WatchSource:0}: Error finding container 954c518ff338c3f8c80e3731ef9fade2d59ae50b8b5d86ff06891bb46f2a9520: Status 404 returned error can't find the container with id 954c518ff338c3f8c80e3731ef9fade2d59ae50b8b5d86ff06891bb46f2a9520 Jul 09 15:12:03.541404 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.541368 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:03.541500 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.541440 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:03.541500 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.541472 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:03.650098 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.650006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerStarted","Data":"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8"} Jul 09 15:12:03.650098 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.650059 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerStarted","Data":"954c518ff338c3f8c80e3731ef9fade2d59ae50b8b5d86ff06891bb46f2a9520"} Jul 09 15:12:03.678189 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:03.678122 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podStartSLOduration=0.678099938 podStartE2EDuration="678.099938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:12:03.674263404 +0000 UTC m=+1914.985674041" watchObservedRunningTime="2026-07-09 15:12:03.678099938 +0000 UTC m=+1914.989510550" Jul 09 15:12:04.390854 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:04.390816 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:04.395871 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:04.395844 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:04.655930 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:04.655840 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:04.656782 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:04.656764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:06.502318 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:06.502287 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:06.557980 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:06.557944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:10.117181 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:10.117149 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:18.925538 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:18.925451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:19.657853 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.657817 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 15:12:19.658078 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.657894 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 15:12:19.755284 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.755189 2572 generic.go:356] "Generic (PLEG): container finished" podID="708c7a03-f892-4c87-bf35-7278abf113ff" containerID="d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8" exitCode=0 Jul 09 15:12:19.755284 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.755267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerDied","Data":"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8"} Jul 09 15:12:19.755704 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.755684 2572 scope.go:117] "RemoveContainer" containerID="d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8" Jul 09 15:12:19.756753 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.756709 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:19.756839 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.756794 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:19.756839 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:19.756826 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:12:20.762419 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:20.762384 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerStarted","Data":"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714"} Jul 09 15:12:21.390892 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:21.390855 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:21.391135 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:21.391113 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 15:12:21.391191 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:21.391160 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 15:12:22.391818 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:22.391779 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 15:12:22.392217 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:22.391839 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 15:12:23.391482 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:23.391446 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 15:12:23.391667 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:23.391512 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 15:12:24.391650 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:24.391614 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 15:12:24.392157 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:24.391683 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 15:12:24.630954 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:24.630915 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:25.395529 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:25.395499 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:25.395937 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:25.395768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:25.396416 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:25.396397 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:12:42.947959 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:42.947923 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:43.490973 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:43.490931 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:49.012122 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:49.012087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:52.552149 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:52.552105 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:52.667556 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:52.667524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:12:54.093143 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:12:54.093115 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:08.390054 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:08.389963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:08.492800 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:08.492771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:31.506188 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:31.506151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:31.736739 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:31.736692 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:37.641004 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:37.640967 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:37.711077 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:37.711046 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:37.901947 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:37.901864 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:13:37.902140 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:37.902114 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" containerID="cri-o://6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714" gracePeriod=30 Jul 09 15:13:37.927732 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:37.927681 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:39.243868 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:39.243836 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:39.341962 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:39.341929 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:39.441023 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:39.440993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:40.214135 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:40.214102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:40.314462 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:40.314420 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:40.398561 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:40.398524 2572 patch_prober.go:28] interesting pod/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:13:40.398757 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:40.398595 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:13:40.407388 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:40.407356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:41.789418 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:41.789383 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:43.169895 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.169828 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:13:43.199960 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.199926 2572 generic.go:356] "Generic (PLEG): container finished" podID="708c7a03-f892-4c87-bf35-7278abf113ff" containerID="6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714" exitCode=0 Jul 09 15:13:43.200150 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.199991 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" Jul 09 15:13:43.200150 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.200013 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerDied","Data":"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714"} Jul 09 15:13:43.200150 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.200075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4" event={"ID":"708c7a03-f892-4c87-bf35-7278abf113ff","Type":"ContainerDied","Data":"954c518ff338c3f8c80e3731ef9fade2d59ae50b8b5d86ff06891bb46f2a9520"} Jul 09 15:13:43.200150 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.200107 2572 scope.go:117] "RemoveContainer" containerID="6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714" Jul 09 15:13:43.206941 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.206918 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207067 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.206975 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207067 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207012 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207166 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207089 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207166 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207140 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207271 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207171 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drqwx\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207271 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207180 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:13:43.207271 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207196 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207271 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207239 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207481 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207283 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy\") pod \"708c7a03-f892-4c87-bf35-7278abf113ff\" (UID: \"708c7a03-f892-4c87-bf35-7278abf113ff\") " Jul 09 15:13:43.207538 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207490 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:13:43.208028 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207896 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:13:43.208028 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.207955 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:13:43.208299 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.208241 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/708c7a03-f892-4c87-bf35-7278abf113ff-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.208462 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.208436 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.209159 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.209131 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:13:43.209675 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.209649 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:13:43.209922 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.209893 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:13:43.210118 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.210091 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:13:43.210244 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.210218 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx" (OuterVolumeSpecName: "kube-api-access-drqwx") pod "708c7a03-f892-4c87-bf35-7278abf113ff" (UID: "708c7a03-f892-4c87-bf35-7278abf113ff"). InnerVolumeSpecName "kube-api-access-drqwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:13:43.210571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.210554 2572 scope.go:117] "RemoveContainer" containerID="d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8" Jul 09 15:13:43.229100 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.229080 2572 scope.go:117] "RemoveContainer" containerID="6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714" Jul 09 15:13:43.229402 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:13:43.229380 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714\": container with ID starting with 6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714 not found: ID does not exist" containerID="6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714" Jul 09 15:13:43.229496 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.229409 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714"} err="failed to get container status \"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714\": rpc error: code = NotFound desc = could not find container \"6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714\": container with ID starting with 6083a2c179bfad0ca7b1e22d90e7454aaf3cc023e9464ef3560dfa4bc42d5714 not found: ID does not exist" Jul 09 15:13:43.229496 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.229429 2572 scope.go:117] "RemoveContainer" containerID="d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8" Jul 09 15:13:43.229783 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:13:43.229757 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8\": container with ID starting with d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8 not found: ID does not exist" containerID="d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8" Jul 09 15:13:43.229839 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.229794 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8"} err="failed to get container status \"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8\": rpc error: code = NotFound desc = could not find container \"d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8\": container with ID starting with d8f23491455396d84a1bd45dc61f019ea9858d6999d87e29944df0ee1c51a7a8 not found: ID does not exist" Jul 09 15:13:43.309789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309765 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309789 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309791 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drqwx\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-kube-api-access-drqwx\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309801 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/708c7a03-f892-4c87-bf35-7278abf113ff-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309810 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309819 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309827 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/708c7a03-f892-4c87-bf35-7278abf113ff-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.309929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.309834 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/708c7a03-f892-4c87-bf35-7278abf113ff-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:13:43.518249 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.518167 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:13:43.523199 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:43.523171 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-56796089-openshift-default-6bf9f759ff-qzwj4"] Jul 09 15:13:45.301526 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:45.301496 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" path="/var/lib/kubelet/pods/708c7a03-f892-4c87-bf35-7278abf113ff/volumes" Jul 09 15:13:47.878784 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:47.878712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:47.979929 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:47.979884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:48.557587 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:48.557559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:54.569198 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:54.569159 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:54.704135 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:54.704100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:13:54.798272 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:13:54.798232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:05.331258 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:05.331218 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:07.576477 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:07.576442 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:26.608934 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:26.608904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:32.643357 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:32.643263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:32.713158 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:32.713125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:33.293411 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.293375 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:14:33.293901 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.293872 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:33.293901 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.293893 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:33.294082 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.293913 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:33.294082 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.293923 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:33.294082 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.294009 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:33.294082 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.294025 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5aa643f-b1ba-4663-9394-94689fd1a08d" containerName="istio-proxy" Jul 09 15:14:33.297274 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.297247 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.300385 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.300364 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5ffef3-openshift-default-dockercfg-xqfbj\"" Jul 09 15:14:33.309546 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.309518 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:14:33.356151 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356356 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356196 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356356 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356568 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356545 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356639 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356599 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356703 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356791 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356910 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.356910 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.356830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txl2\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457617 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457644 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457702 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457795 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.457850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txl2\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458210 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458210 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.457929 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458210 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.458106 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458210 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.458128 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458413 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.458260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458413 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.458369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.458571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.458541 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.460453 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.460430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.460561 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.460536 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.467338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.467309 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.467472 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.467454 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txl2\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2\") pod \"e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.610575 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.610484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:33.753769 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.753744 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:14:33.755228 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:14:33.755203 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abde57a_fc0b_4e4f_a875_5280790b346a.slice/crio-a51f8eadf47a5565315d144383851788e9031a6c9d871d898f5a86bec26129cf WatchSource:0}: Error finding container a51f8eadf47a5565315d144383851788e9031a6c9d871d898f5a86bec26129cf: Status 404 returned error can't find the container with id a51f8eadf47a5565315d144383851788e9031a6c9d871d898f5a86bec26129cf Jul 09 15:14:33.757738 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.757694 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:33.757806 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.757777 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:33.757843 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:33.757807 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:34.471065 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.471029 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerStarted","Data":"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee"} Jul 09 15:14:34.471254 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.471080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerStarted","Data":"a51f8eadf47a5565315d144383851788e9031a6c9d871d898f5a86bec26129cf"} Jul 09 15:14:34.497192 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.497142 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podStartSLOduration=1.4971267959999999 podStartE2EDuration="1.497126796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:14:34.494382175 +0000 UTC m=+2065.805792798" watchObservedRunningTime="2026-07-09 15:14:34.497126796 +0000 UTC m=+2065.808537407" Jul 09 15:14:34.610800 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.610767 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:34.615998 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.615974 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:34.724916 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.724823 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:34.822364 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:34.822330 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:35.477120 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:35.477087 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:35.477990 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:35.477970 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:36.411474 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:36.411302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:36.507294 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:36.507259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:36.590623 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:36.590594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:36.710265 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:36.710174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:37.062408 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:37.062377 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:37.161898 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:37.161847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:40.908940 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:40.908876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:41.308707 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.308679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:41.547797 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.547760 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:14:41.548258 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.548243 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="708c7a03-f892-4c87-bf35-7278abf113ff" containerName="istio-proxy" Jul 09 15:14:41.551279 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.551261 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.554425 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.554407 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e3e936-openshift-default-dockercfg-kpztt\"" Jul 09 15:14:41.567039 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.566971 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:14:41.579400 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.579374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:41.635446 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635642 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635642 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635550 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635642 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635601 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x55sd\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.635830 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.636024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.635835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.736969 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.736932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737162 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.736988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737162 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x55sd\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737162 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737162 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737376 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737376 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737376 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737525 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737456 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737525 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737525 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737512 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.737685 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737588 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.738026 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.737999 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.738026 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.738021 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.739630 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.739603 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.739630 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.739624 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.747420 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.747397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x55sd\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.753074 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.753049 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token\") pod \"e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:41.818368 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.818281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:41.862868 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:41.862835 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:42.007834 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.007808 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:14:42.009236 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:14:42.009204 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b2b755_b401_4973_9d16_ff371a4944b5.slice/crio-5e8b3250c2ef2895467a24cf43b1222cecd10e5628d6fec4d2676d41103370a2 WatchSource:0}: Error finding container 5e8b3250c2ef2895467a24cf43b1222cecd10e5628d6fec4d2676d41103370a2: Status 404 returned error can't find the container with id 5e8b3250c2ef2895467a24cf43b1222cecd10e5628d6fec4d2676d41103370a2 Jul 09 15:14:42.011487 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.011457 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:42.011568 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.011531 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:42.011607 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.011563 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:42.515615 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.515515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerStarted","Data":"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b"} Jul 09 15:14:42.515615 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.515580 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerStarted","Data":"5e8b3250c2ef2895467a24cf43b1222cecd10e5628d6fec4d2676d41103370a2"} Jul 09 15:14:42.863612 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:42.863571 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:43.868030 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:43.867996 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:43.891669 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:43.891604 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podStartSLOduration=2.891583037 podStartE2EDuration="2.891583037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:14:42.538501124 +0000 UTC m=+2073.849911736" watchObservedRunningTime="2026-07-09 15:14:43.891583037 +0000 UTC m=+2075.202993648" Jul 09 15:14:44.449548 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.449513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:44.528493 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.528455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:44.529828 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.529765 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:14:44.550743 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.550694 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:44.653525 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.653491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:44.896664 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:44.896634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:45.111515 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:45.111482 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:45.213437 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:45.213344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:48.924659 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:48.924620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:51.518944 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:51.518897 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 15:14:51.519397 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:51.518979 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 15:14:53.579417 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.579387 2572 generic.go:356] "Generic (PLEG): container finished" podID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerID="7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee" exitCode=0 Jul 09 15:14:53.579856 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.579461 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerDied","Data":"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee"} Jul 09 15:14:53.579905 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.579880 2572 scope.go:117] "RemoveContainer" containerID="7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee" Jul 09 15:14:53.580951 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.580927 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:53.581019 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.580992 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:53.581060 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:53.581028 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:14:54.502254 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:54.502156 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:54.586399 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:54.586359 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerStarted","Data":"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87"} Jul 09 15:14:54.611163 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:54.611126 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:54.611537 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:54.611452 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 15:14:54.611757 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:54.611704 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 15:14:55.611368 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:55.611326 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 15:14:55.611899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:55.611404 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 15:14:56.611837 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:56.611794 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 15:14:56.612439 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:56.612405 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 15:14:57.611695 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:57.611660 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 15:14:57.611997 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:57.611969 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 15:14:57.879692 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:57.879604 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:57.984128 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:57.984085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:14:58.617620 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:58.617591 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 15:14:58.618240 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:58.618210 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 15:14:59.615134 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:59.615102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:59.615452 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:59.615435 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:14:59.616172 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:14:59.616152 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:15:00.570961 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:00.570912 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 15:15:00.571440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:00.571012 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 15:15:02.641333 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.641296 2572 generic.go:356] "Generic (PLEG): container finished" podID="18b2b755-b401-4973-9d16-ff371a4944b5" containerID="06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b" exitCode=0 Jul 09 15:15:02.641780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.641372 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerDied","Data":"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b"} Jul 09 15:15:02.641832 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.641808 2572 scope.go:117] "RemoveContainer" containerID="06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b" Jul 09 15:15:02.642845 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.642817 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:15:02.642957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.642920 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:15:02.643022 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:02.642969 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:15:03.648287 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:03.648248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerStarted","Data":"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c"} Jul 09 15:15:03.863806 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:03.863773 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:15:03.864072 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:03.864051 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 15:15:03.864122 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:03.864095 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 15:15:04.864274 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:04.864231 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 15:15:04.864700 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:04.864298 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 15:15:05.863916 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:05.863875 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 15:15:05.864135 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:05.863935 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 15:15:06.018919 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:06.018865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:15:06.156990 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:06.156899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:15:06.864239 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:06.864199 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 15:15:06.864457 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:06.864267 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 15:15:07.863326 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:07.863290 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 15:15:07.863776 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:07.863349 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 15:15:08.867247 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:08.867214 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:15:08.867686 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:08.867478 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:15:08.868183 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:08.868160 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:15:09.346393 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:09.346362 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:15:09.347833 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:09.347812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:15:09.348222 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:09.348204 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:15:09.349829 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:09.349811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:15:31.318904 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:31.318871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:15:59.436867 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:15:59.436783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:13.668389 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:13.668348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:14.561374 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:14.561337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:14.721343 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:14.721296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:15.125256 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:15.125227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:15.247338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:15.247300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:15.345846 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:15.345803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:15.505807 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:15.505715 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:20.204354 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:20.204296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:57.599793 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:57.599757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:57.872637 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:57.872551 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:16:57.872799 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:57.872773 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" containerID="cri-o://a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87" gracePeriod=30 Jul 09 15:16:57.914928 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:57.914892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:58.276492 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:58.276461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:58.681519 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:58.681426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:58.782219 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:58.782191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:58.885708 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:58.885663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:58.966073 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:58.965990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:16:59.618656 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:59.618613 2572 patch_prober.go:28] interesting pod/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:16:59.618841 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:16:59.618693 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:17:03.126848 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.126818 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:17:03.205620 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205521 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205810 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205650 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205810 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205768 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205810 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205802 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205973 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205973 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205892 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.205973 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205928 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.206134 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.205971 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.206134 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206011 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8txl2\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2\") pod \"8abde57a-fc0b-4e4f-a875-5280790b346a\" (UID: \"8abde57a-fc0b-4e4f-a875-5280790b346a\") " Jul 09 15:17:03.206134 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206080 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:03.206297 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206129 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:03.206297 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206144 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:03.206475 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206453 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.206551 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206480 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.206551 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206495 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.206858 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.206612 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:17:03.207024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.207001 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data" (OuterVolumeSpecName: "istio-data") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:03.208143 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.208121 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:17:03.208264 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.208148 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token" (OuterVolumeSpecName: "istio-token") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:03.208522 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.208502 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:03.208522 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.208509 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2" (OuterVolumeSpecName: "kube-api-access-8txl2") pod "8abde57a-fc0b-4e4f-a875-5280790b346a" (UID: "8abde57a-fc0b-4e4f-a875-5280790b346a"). InnerVolumeSpecName "kube-api-access-8txl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:03.283641 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.283606 2572 generic.go:356] "Generic (PLEG): container finished" podID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerID="a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87" exitCode=0 Jul 09 15:17:03.283833 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.283657 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" Jul 09 15:17:03.283833 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.283673 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerDied","Data":"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87"} Jul 09 15:17:03.283833 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.283747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7" event={"ID":"8abde57a-fc0b-4e4f-a875-5280790b346a","Type":"ContainerDied","Data":"a51f8eadf47a5565315d144383851788e9031a6c9d871d898f5a86bec26129cf"} Jul 09 15:17:03.283833 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.283775 2572 scope.go:117] "RemoveContainer" containerID="a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87" Jul 09 15:17:03.298522 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.298494 2572 scope.go:117] "RemoveContainer" containerID="7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee" Jul 09 15:17:03.307479 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307454 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.307479 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307476 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.307479 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307486 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8abde57a-fc0b-4e4f-a875-5280790b346a-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.307758 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307494 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8txl2\" (UniqueName: \"kubernetes.io/projected/8abde57a-fc0b-4e4f-a875-5280790b346a-kube-api-access-8txl2\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.307758 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307504 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.307758 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.307513 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8abde57a-fc0b-4e4f-a875-5280790b346a-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:03.308619 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.308592 2572 scope.go:117] "RemoveContainer" containerID="a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87" Jul 09 15:17:03.309291 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:03.309264 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87\": container with ID starting with a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87 not found: ID does not exist" containerID="a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87" Jul 09 15:17:03.309424 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.309304 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87"} err="failed to get container status \"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87\": rpc error: code = NotFound desc = could not find container \"a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87\": container with ID starting with a09612537f1ba1d277ced18b830e819b33668a7bfd2a716c94cff33a44186f87 not found: ID does not exist" Jul 09 15:17:03.309424 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.309332 2572 scope.go:117] "RemoveContainer" containerID="7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee" Jul 09 15:17:03.309708 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:03.309658 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee\": container with ID starting with 7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee not found: ID does not exist" containerID="7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee" Jul 09 15:17:03.309874 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.309703 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee"} err="failed to get container status \"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee\": rpc error: code = NotFound desc = could not find container \"7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee\": container with ID starting with 7a60ba57992567e6b2f08546ac5234a6f06a460a27689de4cd72072868a1b0ee not found: ID does not exist" Jul 09 15:17:03.312553 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.312527 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:17:03.318106 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:03.318079 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5ffef3-openshift-default-bf4cb8c4c-bhjm7"] Jul 09 15:17:04.718527 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:04.718493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:04.776497 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:04.776467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:05.034560 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.034523 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:17:05.034775 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.034740 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" containerID="cri-o://eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c" gracePeriod=30 Jul 09 15:17:05.143809 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.143771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:05.300013 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.299918 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" path="/var/lib/kubelet/pods/8abde57a-fc0b-4e4f-a875-5280790b346a/volumes" Jul 09 15:17:05.597510 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.597422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:05.929325 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:05.929230 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:06.112583 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:06.112549 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:08.869874 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:08.869830 2572 patch_prober.go:28] interesting pod/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 15:17:08.870305 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:08.869897 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:17:10.306951 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.306879 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:17:10.332943 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.332907 2572 generic.go:356] "Generic (PLEG): container finished" podID="18b2b755-b401-4973-9d16-ff371a4944b5" containerID="eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c" exitCode=0 Jul 09 15:17:10.333138 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.332967 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" Jul 09 15:17:10.333138 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.332996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerDied","Data":"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c"} Jul 09 15:17:10.333138 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.333093 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf" event={"ID":"18b2b755-b401-4973-9d16-ff371a4944b5","Type":"ContainerDied","Data":"5e8b3250c2ef2895467a24cf43b1222cecd10e5628d6fec4d2676d41103370a2"} Jul 09 15:17:10.333138 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.333124 2572 scope.go:117] "RemoveContainer" containerID="eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c" Jul 09 15:17:10.345254 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.345228 2572 scope.go:117] "RemoveContainer" containerID="06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b" Jul 09 15:17:10.355984 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.355951 2572 scope.go:117] "RemoveContainer" containerID="eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c" Jul 09 15:17:10.356262 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:10.356243 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c\": container with ID starting with eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c not found: ID does not exist" containerID="eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c" Jul 09 15:17:10.356345 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.356272 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c"} err="failed to get container status \"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c\": rpc error: code = NotFound desc = could not find container \"eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c\": container with ID starting with eb99bc6ed60e8999e8fa66ff2f8b41ec8b4b1646f254e0a06c1482f29282676c not found: ID does not exist" Jul 09 15:17:10.356345 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.356292 2572 scope.go:117] "RemoveContainer" containerID="06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b" Jul 09 15:17:10.356538 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:10.356522 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b\": container with ID starting with 06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b not found: ID does not exist" containerID="06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b" Jul 09 15:17:10.356598 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.356542 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b"} err="failed to get container status \"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b\": rpc error: code = NotFound desc = could not find container \"06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b\": container with ID starting with 06ac261549f5adcc569e117cf2ffcb0d59fbaa6c999d56d26ebc59b27db8d48b not found: ID does not exist" Jul 09 15:17:10.475207 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475170 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475207 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475209 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475236 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475270 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475310 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475340 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475502 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475597 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x55sd\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd\") pod \"18b2b755-b401-4973-9d16-ff371a4944b5\" (UID: \"18b2b755-b401-4973-9d16-ff371a4944b5\") " Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475653 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475698 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:10.475836 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.475754 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:17:10.476177 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.476014 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.476177 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.476032 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18b2b755-b401-4973-9d16-ff371a4944b5-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.476177 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.476046 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.476177 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.476059 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.476640 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.476610 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:10.477811 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.477779 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:10.477928 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.477910 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd" (OuterVolumeSpecName: "kube-api-access-x55sd") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "kube-api-access-x55sd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:10.478293 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.478262 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:10.478293 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.478267 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18b2b755-b401-4973-9d16-ff371a4944b5" (UID: "18b2b755-b401-4973-9d16-ff371a4944b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:17:10.576571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.576480 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.576571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.576512 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18b2b755-b401-4973-9d16-ff371a4944b5-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.576571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.576521 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18b2b755-b401-4973-9d16-ff371a4944b5-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.576571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.576530 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x55sd\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-kube-api-access-x55sd\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.576571 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.576543 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b2b755-b401-4973-9d16-ff371a4944b5-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:10.657049 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.657014 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:17:10.661145 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:10.661120 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e3e936-openshift-default-68c9788857-pw5jf"] Jul 09 15:17:11.300757 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:11.300703 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" path="/var/lib/kubelet/pods/18b2b755-b401-4973-9d16-ff371a4944b5/volumes" Jul 09 15:17:11.962580 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:11.962543 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:12.071403 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:12.071369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:13.014144 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:13.014113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:13.115099 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:13.115068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:16.454478 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:16.454448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:16.928933 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:16.928899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:17.215837 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.215752 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:17.216172 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216155 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.216215 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216179 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.216215 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216193 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216215 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216202 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216312 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216215 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216312 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216227 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216312 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216263 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.216312 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216272 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.216440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216368 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216382 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b2b755-b401-4973-9d16-ff371a4944b5" containerName="istio-proxy" Jul 09 15:17:17.216440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216395 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.216440 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.216404 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abde57a-fc0b-4e4f-a875-5280790b346a" containerName="istio-proxy" Jul 09 15:17:17.219658 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.219639 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.223230 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.223208 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e7df1b-openshift-default-dockercfg-nqsw8\"" Jul 09 15:17:17.239481 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.239456 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:17.244812 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.244791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.244921 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.244822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.244921 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.244848 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245052 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.244955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245052 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.244991 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245052 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.245017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245207 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.245091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245207 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.245120 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ttq\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.245207 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.245177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.255130 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.255085 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:17.346030 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.345982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ttq\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346320 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346493 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346506 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.346898 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.346805 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.347033 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.347015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.347080 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.347062 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.349020 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.348995 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.349238 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.349218 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.360951 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.360922 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.361053 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.360976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ttq\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq\") pod \"e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.395077 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.395044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:17.529978 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.529949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:17.696504 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.696480 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:17.698105 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:17:17.698081 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d42a0f_ff07_42a9_91d5_aa92d763d9c6.slice/crio-4f9d664a3f8b7e3f85f244528f98d95f8aba8889b1942a06b3f376416149d1a4 WatchSource:0}: Error finding container 4f9d664a3f8b7e3f85f244528f98d95f8aba8889b1942a06b3f376416149d1a4: Status 404 returned error can't find the container with id 4f9d664a3f8b7e3f85f244528f98d95f8aba8889b1942a06b3f376416149d1a4 Jul 09 15:17:17.700200 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.700171 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:17.700275 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.700238 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:17.700275 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:17.700271 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:18.384578 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:18.384541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerStarted","Data":"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f"} Jul 09 15:17:18.384938 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:18.384600 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerStarted","Data":"4f9d664a3f8b7e3f85f244528f98d95f8aba8889b1942a06b3f376416149d1a4"} Jul 09 15:17:18.407054 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:18.407000 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podStartSLOduration=1.406984523 podStartE2EDuration="1.406984523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:17:18.404641465 +0000 UTC m=+2229.716052076" watchObservedRunningTime="2026-07-09 15:17:18.406984523 +0000 UTC m=+2229.718395133" Jul 09 15:17:18.530211 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:18.530174 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:18.535267 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:18.535242 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:19.389672 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:19.389643 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:19.390706 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:19.390675 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:20.496315 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:20.496281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:20.631167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:20.631134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:20.726568 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:20.726530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:21.376709 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:21.376679 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:21.484624 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:21.484594 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:24.897346 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:24.897315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:32.922616 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:32.922579 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:33.402791 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.402757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:33.469004 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.468971 2572 generic.go:356] "Generic (PLEG): container finished" podID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerID="0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f" exitCode=0 Jul 09 15:17:33.469176 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.469036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerDied","Data":"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f"} Jul 09 15:17:33.469536 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.469521 2572 scope.go:117] "RemoveContainer" containerID="0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f" Jul 09 15:17:33.470635 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.470605 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:33.470752 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.470687 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:33.470804 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.470761 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:33.496987 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.496962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:33.582810 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.582769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:33.683222 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.683102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:33.781050 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:33.781011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:34.390450 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:34.390411 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:34.475979 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:34.475950 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerStarted","Data":"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb"} Jul 09 15:17:34.531006 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:34.530972 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:34.532250 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:34.532231 2572 patch_prober.go:28] interesting pod/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 09 15:17:34.532317 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:34.532275 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 09 15:17:35.530662 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:35.530623 2572 patch_prober.go:28] interesting pod/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 09 15:17:35.531100 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:35.530688 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 09 15:17:36.531202 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:36.531165 2572 patch_prober.go:28] interesting pod/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 09 15:17:36.531599 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:36.531222 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 09 15:17:37.531251 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:37.531212 2572 patch_prober.go:28] interesting pod/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 09 15:17:37.531650 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:37.531271 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 09 15:17:38.535241 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:38.535211 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:38.535669 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:38.535481 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:38.536110 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:38.536095 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:39.080423 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:39.080389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:39.155357 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:39.155321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:39.345344 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:39.345264 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:39.708772 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:39.708656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:40.106625 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:40.106593 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:40.207565 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:40.207531 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:40.307417 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:40.307347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:40.410306 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:40.410198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:42.986367 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:42.986310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:45.999295 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:45.999256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:46.105712 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:46.105674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:46.277160 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:46.277131 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:46.277361 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:46.277338 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" containerID="cri-o://6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb" gracePeriod=30 Jul 09 15:17:46.296455 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:46.296427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:46.857462 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:46.857417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:47.344265 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:47.344221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:47.474702 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:47.474672 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:50.223219 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:50.223175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:50.383160 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:50.383125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:50.469622 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:50.469581 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:50.860784 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:50.860736 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:50.960970 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:50.960927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:51.536112 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.536047 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:51.567957 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.567928 2572 generic.go:356] "Generic (PLEG): container finished" podID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerID="6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb" exitCode=0 Jul 09 15:17:51.568129 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.567998 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerDied","Data":"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb"} Jul 09 15:17:51.568129 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.568039 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" Jul 09 15:17:51.568129 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.568055 2572 scope.go:117] "RemoveContainer" containerID="6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb" Jul 09 15:17:51.568269 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.568043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp" event={"ID":"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6","Type":"ContainerDied","Data":"4f9d664a3f8b7e3f85f244528f98d95f8aba8889b1942a06b3f376416149d1a4"} Jul 09 15:17:51.576792 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.576768 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6ttq\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.576928 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.576803 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.576928 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.576828 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.576986 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577023 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577156 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577047 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577156 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577100 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577156 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577144 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.577416 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577396 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:51.578357 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577493 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.578357 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.577801 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:51.578357 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.578305 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:51.578703 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.578668 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:51.579399 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.579364 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:51.579660 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.579634 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq" (OuterVolumeSpecName: "kube-api-access-j6ttq") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "kube-api-access-j6ttq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:17:51.579780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.579669 2572 scope.go:117] "RemoveContainer" containerID="0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f" Jul 09 15:17:51.579780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.579670 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:17:51.579780 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.579715 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:17:51.599447 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.599408 2572 scope.go:117] "RemoveContainer" containerID="6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb" Jul 09 15:17:51.599766 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:51.599715 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb\": container with ID starting with 6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb not found: ID does not exist" containerID="6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb" Jul 09 15:17:51.599850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.599780 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb"} err="failed to get container status \"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb\": rpc error: code = NotFound desc = could not find container \"6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb\": container with ID starting with 6f00310839d35813fe38266048a45cf1dd825e0b94b3c1defba065cb87600fcb not found: ID does not exist" Jul 09 15:17:51.599850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.599805 2572 scope.go:117] "RemoveContainer" containerID="0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f" Jul 09 15:17:51.600097 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:17:51.600077 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f\": container with ID starting with 0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f not found: ID does not exist" containerID="0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f" Jul 09 15:17:51.600144 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.600102 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f"} err="failed to get container status \"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f\": rpc error: code = NotFound desc = could not find container \"0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f\": container with ID starting with 0a9495a76d5a22c38066222784b1f2ef079cd0763886bc5cf851bd10f59bfd8f not found: ID does not exist" Jul 09 15:17:51.678595 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678553 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert\") pod \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\" (UID: \"f4d42a0f-ff07-42a9-91d5-aa92d763d9c6\") " Jul 09 15:17:51.678823 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678805 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6ttq\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-kube-api-access-j6ttq\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678823 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678817 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678920 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678826 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678920 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678834 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678920 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678842 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678920 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678850 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.678920 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678860 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.679075 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.678966 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" (UID: "f4d42a0f-ff07-42a9-91d5-aa92d763d9c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:17:51.780218 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.780176 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:17:51.895364 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.895331 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:51.902712 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:51.902677 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e7df1b-openshift-default-7b5bd667-bhpcp"] Jul 09 15:17:53.300593 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:53.300559 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" path="/var/lib/kubelet/pods/f4d42a0f-ff07-42a9-91d5-aa92d763d9c6/volumes" Jul 09 15:17:54.098046 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:54.098003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:54.199225 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:54.199192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:54.705080 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:54.705030 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:55.035449 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.035411 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:55.330579 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330505 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:17:55.330885 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330872 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:17:55.330948 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330887 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:17:55.330948 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330899 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:17:55.330948 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330904 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:17:55.331053 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.330963 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:17:55.334072 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.334053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.338539 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.338518 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-996688-openshift-default-dockercfg-fnrrl\"" Jul 09 15:17:55.356759 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.356732 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:17:55.380431 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.380400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:55.413490 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413525 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413661 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413859 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413859 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rzd\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.413859 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.413791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.514866 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.514823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.514866 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.514865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.514901 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.514933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rzd\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.514975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515045 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515126 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515423 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515135 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515423 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515250 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515423 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515345 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515594 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515436 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515594 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515504 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.515679 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.515662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.517499 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.517476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.517737 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.517706 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.531176 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.531150 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.531342 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.531323 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rzd\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd\") pod \"e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.533977 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.533947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:55.644669 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.644562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:55.796230 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.796198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:17:55.797349 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:17:55.797326 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604bc41b_f535_455d_b5a0_2b1cd808c2f7.slice/crio-557c64b7184da0480d30f2e365252ea1bf79170ce6836b35aa7f1f59b1d9c5c9 WatchSource:0}: Error finding container 557c64b7184da0480d30f2e365252ea1bf79170ce6836b35aa7f1f59b1d9c5c9: Status 404 returned error can't find the container with id 557c64b7184da0480d30f2e365252ea1bf79170ce6836b35aa7f1f59b1d9c5c9 Jul 09 15:17:55.799521 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.799488 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:55.799579 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.799557 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:55.799613 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:55.799583 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:17:56.597794 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:56.597754 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerStarted","Data":"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4"} Jul 09 15:17:56.598011 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:56.597813 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerStarted","Data":"557c64b7184da0480d30f2e365252ea1bf79170ce6836b35aa7f1f59b1d9c5c9"} Jul 09 15:17:56.626259 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:56.626209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" podStartSLOduration=1.6261944160000001 podStartE2EDuration="1.626194416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:17:56.624195351 +0000 UTC m=+2267.935606096" watchObservedRunningTime="2026-07-09 15:17:56.626194416 +0000 UTC m=+2267.937605027" Jul 09 15:17:56.645766 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:56.645711 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:56.650844 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:56.650816 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:57.604003 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:57.603972 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:57.604996 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:57.604978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:17:58.547060 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:58.547027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:58.632056 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:58.632018 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:58.712325 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:58.712291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:59.213981 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:59.213948 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:59.313153 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:59.313118 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:17:59.421805 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:17:59.421763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:18:03.052086 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:03.052048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:18:11.690316 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.690283 2572 generic.go:356] "Generic (PLEG): container finished" podID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerID="a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4" exitCode=0 Jul 09 15:18:11.690767 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.690362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerDied","Data":"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4"} Jul 09 15:18:11.690831 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.690780 2572 scope.go:117] "RemoveContainer" containerID="a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4" Jul 09 15:18:11.691757 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.691734 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:18:11.691832 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.691800 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:18:11.691872 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.691829 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 15:18:11.712883 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:11.712855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:18:12.604436 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:12.604322 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:18:12.699934 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:12.699891 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerStarted","Data":"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700"} Jul 09 15:18:13.061095 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:13.061061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:18:13.645379 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:13.645340 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:18:13.646707 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:13.646677 2572 patch_prober.go:28] interesting pod/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 09 15:18:13.646863 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:13.646759 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 09 15:18:14.645366 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:14.645330 2572 patch_prober.go:28] interesting pod/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 09 15:18:14.645817 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:14.645396 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 09 15:18:15.645861 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:15.645817 2572 patch_prober.go:28] interesting pod/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 09 15:18:15.646266 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:15.645898 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 09 15:18:16.649629 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:16.649598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:18:16.650139 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:16.650028 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:18:16.650659 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:16.650643 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:18:20.901318 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:20.901282 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:18:21.003899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:18:21.003852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:19:09.570488 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:19:09.570406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:19:11.360827 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:19:11.360789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:20:09.381784 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:09.381752 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:20:09.384012 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:09.383989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:20:09.385253 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:09.385227 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:20:09.387360 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:09.387339 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:20:16.323343 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:16.323294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:20:46.924209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:20:46.924122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:06.472969 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:06.472935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:06.537232 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:06.537199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:09.214981 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:09.214952 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:09.280026 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:09.279996 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:14.232674 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:14.232634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:14.298560 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:14.298495 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:14.495566 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:14.495450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:14.885899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:14.885818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:15.307470 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:15.307437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:15.481302 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:15.481266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:15.578397 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:15.578316 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:15.715563 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:15.715528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:21.174359 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:21.174315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:21.275195 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:21.275154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:21.431513 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:21.431430 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:21:21.431666 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:21.431645 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" containerID="cri-o://9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700" gracePeriod=30 Jul 09 15:21:21.449330 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:21.449293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:26.692328 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.692298 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:21:26.738430 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738336 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738430 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738382 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738684 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738477 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738684 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738558 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738684 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738658 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738694 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:21:26.738899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738761 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2rzd\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.738899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738780 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:21:26.738899 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738789 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.739122 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.739122 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.738981 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token\") pod \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\" (UID: \"604bc41b-f535-455d-b5a0-2b1cd808c2f7\") " Jul 09 15:21:26.739224 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739118 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:21:26.739224 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739109 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:21:26.739338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739318 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-credential-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.739338 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739334 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-socket\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.739445 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739347 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-workload-certs\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.739445 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739359 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istiod-ca-cert\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.739557 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.739530 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:21:26.740974 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.740945 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:21:26.741304 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.741283 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:21:26.741438 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.741419 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:21:26.741529 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.741514 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd" (OuterVolumeSpecName: "kube-api-access-j2rzd") pod "604bc41b-f535-455d-b5a0-2b1cd808c2f7" (UID: "604bc41b-f535-455d-b5a0-2b1cd808c2f7"). InnerVolumeSpecName "kube-api-access-j2rzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:21:26.755035 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.755006 2572 generic.go:356] "Generic (PLEG): container finished" podID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerID="9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700" exitCode=0 Jul 09 15:21:26.755189 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.755047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerDied","Data":"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700"} Jul 09 15:21:26.755189 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.755072 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" Jul 09 15:21:26.755189 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.755102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2" event={"ID":"604bc41b-f535-455d-b5a0-2b1cd808c2f7","Type":"ContainerDied","Data":"557c64b7184da0480d30f2e365252ea1bf79170ce6836b35aa7f1f59b1d9c5c9"} Jul 09 15:21:26.755189 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.755127 2572 scope.go:117] "RemoveContainer" containerID="9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700" Jul 09 15:21:26.765628 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.765606 2572 scope.go:117] "RemoveContainer" containerID="a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4" Jul 09 15:21:26.774983 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.774961 2572 scope.go:117] "RemoveContainer" containerID="9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700" Jul 09 15:21:26.775811 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:21:26.775389 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700\": container with ID starting with 9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700 not found: ID does not exist" containerID="9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700" Jul 09 15:21:26.775811 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.775427 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700"} err="failed to get container status \"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700\": rpc error: code = NotFound desc = could not find container \"9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700\": container with ID starting with 9b08e11adc0ba11de77f01dba6d2dfc7a7caa1f97a0548a1e8d1076edf2e7700 not found: ID does not exist" Jul 09 15:21:26.775811 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.775454 2572 scope.go:117] "RemoveContainer" containerID="a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4" Jul 09 15:21:26.776027 ip-10-0-140-95 kubenswrapper[2572]: E0709 15:21:26.776005 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4\": container with ID starting with a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4 not found: ID does not exist" containerID="a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4" Jul 09 15:21:26.776066 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.776036 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4"} err="failed to get container status \"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4\": rpc error: code = NotFound desc = could not find container \"a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4\": container with ID starting with a27462f381af5af383d8c6e7fbaaf222bbcb8b39a8e5d4d209ca84fdc40a85a4 not found: ID does not exist" Jul 09 15:21:26.778705 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.778682 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:21:26.781896 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.781874 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-996688-openshift-default-5974db9b4c-tv5z2"] Jul 09 15:21:26.840706 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.840666 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-envoy\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.840706 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.840694 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-podinfo\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.840706 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.840705 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-data\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.840706 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.840713 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2rzd\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-kube-api-access-j2rzd\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:26.841012 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:26.840750 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/604bc41b-f535-455d-b5a0-2b1cd808c2f7-istio-token\") on node \"ip-10-0-140-95.ec2.internal\" DevicePath \"\"" Jul 09 15:21:27.300750 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:27.300681 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" path="/var/lib/kubelet/pods/604bc41b-f535-455d-b5a0-2b1cd808c2f7/volumes" Jul 09 15:21:27.724236 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:27.724157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-5gt6r_f1ecbc32-4a0d-44a7-8bce-f33b2e694073/copy-manifests/0.log" Jul 09 15:21:27.731490 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:27.731444 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-5gt6r_f1ecbc32-4a0d-44a7-8bce-f33b2e694073/manager/0.log" Jul 09 15:21:28.808045 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.808014 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/util/0.log" Jul 09 15:21:28.815425 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.815396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/pull/0.log" Jul 09 15:21:28.821652 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.821616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/extract/0.log" Jul 09 15:21:28.943596 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.943564 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/util/0.log" Jul 09 15:21:28.949575 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.949539 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/pull/0.log" Jul 09 15:21:28.955053 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:28.955028 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/extract/0.log" Jul 09 15:21:29.090520 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.090440 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/util/0.log" Jul 09 15:21:29.097273 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.097220 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/pull/0.log" Jul 09 15:21:29.103325 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.103306 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/extract/0.log" Jul 09 15:21:29.220811 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.220783 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/pull/0.log" Jul 09 15:21:29.227090 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.227062 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/extract/0.log" Jul 09 15:21:29.232760 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:29.232708 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/util/0.log" Jul 09 15:21:30.592945 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:30.592916 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dqxh48_d20db7f9-bc04-4edf-9b10-cbd4454e9d99/istio-proxy/0.log" Jul 09 15:21:30.716167 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:30.716137 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tqt7r_a6303d73-ea5d-40e9-b1bc-35c6f42ff16a/discovery/0.log" Jul 09 15:21:31.082759 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:31.082706 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/1.log" Jul 09 15:21:31.217850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:31.217821 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vzqnz_afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9/payload-pre-processing/0.log" Jul 09 15:21:31.930037 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:31.930003 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pj92g_1ce1ce58-5b5b-49fc-b30c-62f8499ccfbe/main/0.log" Jul 09 15:21:32.292171 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:32.292140 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-87zrb_d369ce1f-b913-4a74-8824-626d3863621f/main/0.log" Jul 09 15:21:36.514389 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:36.514344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:36.615362 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:36.615318 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" limit=1024 Jul 09 15:21:39.400474 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:39.400437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pxvxg_20cbf36b-ad6d-48a1-b0af-d4b7fd747995/global-pull-secret-syncer/0.log" Jul 09 15:21:39.493127 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:39.493092 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-59d2z_ec6c0aff-a0ba-4536-ad3b-0363debd5403/konnectivity-agent/0.log" Jul 09 15:21:39.590023 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:39.589995 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-95.ec2.internal_1fb4eca1d55ac7e08dfc34b0b4593437/haproxy/0.log" Jul 09 15:21:43.806034 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.805994 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/extract/0.log" Jul 09 15:21:43.836077 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.836052 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/util/0.log" Jul 09 15:21:43.863253 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.863218 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594hwlb_f70f1612-a9ed-48e4-bd8c-200dd4f21d31/pull/0.log" Jul 09 15:21:43.897094 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.897068 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/extract/0.log" Jul 09 15:21:43.920640 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.920616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/util/0.log" Jul 09 15:21:43.950567 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.950540 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08mjkl_c584b607-9382-4e65-9500-01eb399a17f0/pull/0.log" Jul 09 15:21:43.984124 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:43.984095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/extract/0.log" Jul 09 15:21:44.009558 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:44.009531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/util/0.log" Jul 09 15:21:44.035054 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:44.035027 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73584gh_69fc6073-f4b7-4be2-87df-bba9e04aef4a/pull/0.log" Jul 09 15:21:44.066110 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:44.066029 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/extract/0.log" Jul 09 15:21:44.092936 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:44.092913 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/util/0.log" Jul 09 15:21:44.116932 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:44.116910 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19pmjq_3332bd09-ea20-4f05-9fed-865f1cde29a8/pull/0.log" Jul 09 15:21:46.540692 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.540666 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/alertmanager/0.log" Jul 09 15:21:46.570516 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.570492 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/config-reloader/0.log" Jul 09 15:21:46.597012 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.596976 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/kube-rbac-proxy-web/0.log" Jul 09 15:21:46.626005 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.625963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/kube-rbac-proxy/0.log" Jul 09 15:21:46.641469 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.641440 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/kube-rbac-proxy-metric/0.log" Jul 09 15:21:46.663526 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.663498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/prom-label-proxy/0.log" Jul 09 15:21:46.685030 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.684992 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8e656a72-e8f7-425d-816b-0bdb85958df5/init-config-reloader/0.log" Jul 09 15:21:46.739225 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.739181 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/1.log" Jul 09 15:21:46.811450 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:46.811351 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gk928_9c3cff45-8900-4f7c-8467-eb13dc4e9cf3/cluster-monitoring-operator/0.log" Jul 09 15:21:47.032675 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:47.032638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-479bn_ede8fa35-a392-4d60-b43a-95f575ff732a/node-exporter/0.log" Jul 09 15:21:47.067917 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:47.067819 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-479bn_ede8fa35-a392-4d60-b43a-95f575ff732a/kube-rbac-proxy/0.log" Jul 09 15:21:47.094276 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:47.094250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-479bn_ede8fa35-a392-4d60-b43a-95f575ff732a/init-textfile/0.log" Jul 09 15:21:49.494680 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.494647 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/2.log" Jul 09 15:21:49.498390 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.498366 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sb2rz_79bec70a-ed65-40a4-871d-186bac01bb73/console-operator/3.log" Jul 09 15:21:49.516968 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.516942 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5"] Jul 09 15:21:49.517341 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517310 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" Jul 09 15:21:49.517341 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517329 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" Jul 09 15:21:49.517518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517352 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" Jul 09 15:21:49.517518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517362 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" Jul 09 15:21:49.517518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517453 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="604bc41b-f535-455d-b5a0-2b1cd808c2f7" containerName="istio-proxy" Jul 09 15:21:49.517518 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.517470 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d42a0f-ff07-42a9-91d5-aa92d763d9c6" containerName="istio-proxy" Jul 09 15:21:49.520688 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.520671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.523850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.523802 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s264d\"/\"kube-root-ca.crt\"" Jul 09 15:21:49.525386 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.525226 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s264d\"/\"openshift-service-ca.crt\"" Jul 09 15:21:49.525386 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.525237 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s264d\"/\"default-dockercfg-pspkd\"" Jul 09 15:21:49.530811 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.530788 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5"] Jul 09 15:21:49.552915 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.552880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-sys\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.553063 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.552987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-podres\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.553063 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.553024 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8hr5\" (UniqueName: \"kubernetes.io/projected/920c22f7-be0b-45a2-b079-6aeff5c17bbb-kube-api-access-j8hr5\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.553063 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.553061 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-proc\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.553187 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.553083 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-lib-modules\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654330 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-podres\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654515 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654339 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8hr5\" (UniqueName: \"kubernetes.io/projected/920c22f7-be0b-45a2-b079-6aeff5c17bbb-kube-api-access-j8hr5\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654515 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654457 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-proc\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654515 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-podres\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654515 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-lib-modules\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654705 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654534 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-sys\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654705 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654538 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-proc\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654705 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654590 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-sys\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.654861 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.654702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/920c22f7-be0b-45a2-b079-6aeff5c17bbb-lib-modules\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.663850 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.663827 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8hr5\" (UniqueName: \"kubernetes.io/projected/920c22f7-be0b-45a2-b079-6aeff5c17bbb-kube-api-access-j8hr5\") pod \"perf-node-gather-daemonset-m82r5\" (UID: \"920c22f7-be0b-45a2-b079-6aeff5c17bbb\") " pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.831453 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.831413 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:49.978630 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:49.978599 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5"] Jul 09 15:21:49.980401 ip-10-0-140-95 kubenswrapper[2572]: W0709 15:21:49.980374 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod920c22f7_be0b_45a2_b079_6aeff5c17bbb.slice/crio-d557745b810c4377b94b4ad273786372867113f7f90552c9a9cff3ed44789dd4 WatchSource:0}: Error finding container d557745b810c4377b94b4ad273786372867113f7f90552c9a9cff3ed44789dd4: Status 404 returned error can't find the container with id d557745b810c4377b94b4ad273786372867113f7f90552c9a9cff3ed44789dd4 Jul 09 15:21:50.054709 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.054682 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57b446567f-fjj99_41819f60-d228-4f8a-a3a0-a7cdbe9a9f72/console/0.log" Jul 09 15:21:50.085174 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.085096 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-xj4qg_a5d9a1cc-6d30-433b-b079-8f1818232ec5/download-server/0.log" Jul 09 15:21:50.615592 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.615562 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-dxv6l_eb4ac7e2-7e46-4dd3-8ae8-c4437776aa46/volume-data-source-validator/0.log" Jul 09 15:21:50.890426 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.890327 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" event={"ID":"920c22f7-be0b-45a2-b079-6aeff5c17bbb","Type":"ContainerStarted","Data":"caf6bbeff02f079459116b5776cfbdd1435257762536f2920bda06ba66916693"} Jul 09 15:21:50.890593 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.890478 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:50.890593 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.890523 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" event={"ID":"920c22f7-be0b-45a2-b079-6aeff5c17bbb","Type":"ContainerStarted","Data":"d557745b810c4377b94b4ad273786372867113f7f90552c9a9cff3ed44789dd4"} Jul 09 15:21:50.911119 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:50.911067 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" podStartSLOduration=1.911052816 podStartE2EDuration="1.911052816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:21:50.909215198 +0000 UTC m=+2502.220625802" watchObservedRunningTime="2026-07-09 15:21:50.911052816 +0000 UTC m=+2502.222463426" Jul 09 15:21:51.695025 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:51.694956 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nzf2s_2126db22-3b96-4206-a6c5-9d37993faea3/dns/0.log" Jul 09 15:21:51.720209 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:51.720176 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nzf2s_2126db22-3b96-4206-a6c5-9d37993faea3/kube-rbac-proxy/0.log" Jul 09 15:21:51.741355 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:51.741326 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5bsh_15512653-13ed-4961-99d1-e3babbf24bf7/dns-node-resolver/0.log" Jul 09 15:21:52.297370 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:52.297343 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dcf7c4dcd-tcfv7_4b9b8b52-756d-4a13-ac2d-2c054c8baf24/registry/0.log" Jul 09 15:21:52.314452 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:52.314429 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bpmkm_6052396f-0d1f-4c75-a63b-2c7b4592e724/node-ca/0.log" Jul 09 15:21:53.254731 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:53.254688 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dqxh48_d20db7f9-bc04-4edf-9b10-cbd4454e9d99/istio-proxy/0.log" Jul 09 15:21:53.359017 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:53.358966 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tqt7r_a6303d73-ea5d-40e9-b1bc-35c6f42ff16a/discovery/0.log" Jul 09 15:21:53.447137 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:53.447105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/0.log" Jul 09 15:21:53.472876 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:53.472844 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/1.log" Jul 09 15:21:53.509028 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:53.508946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vzqnz_afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9/payload-pre-processing/0.log" Jul 09 15:21:54.320970 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:54.320938 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6r5w_c9f0604a-9d2b-463e-aa85-2046acebeecd/serve-healthcheck-canary/0.log" Jul 09 15:21:55.127127 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:55.127095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssnnp_6f6968e1-7f60-41b0-8204-49a824957887/kube-rbac-proxy/0.log" Jul 09 15:21:55.147306 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:55.147273 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssnnp_6f6968e1-7f60-41b0-8204-49a824957887/exporter/0.log" Jul 09 15:21:55.167248 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:55.167222 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssnnp_6f6968e1-7f60-41b0-8204-49a824957887/extractor/0.log" Jul 09 15:21:56.906501 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:56.906474 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s264d/perf-node-gather-daemonset-m82r5" Jul 09 15:21:57.750566 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:57.750540 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-5gt6r_f1ecbc32-4a0d-44a7-8bce-f33b2e694073/manager/0.log" Jul 09 15:21:57.772355 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:57.772328 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dd54665dd-5gt6r_f1ecbc32-4a0d-44a7-8bce-f33b2e694073/copy-manifests/0.log" Jul 09 15:21:59.138445 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.138411 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dqxh48_d20db7f9-bc04-4edf-9b10-cbd4454e9d99/istio-proxy/0.log" Jul 09 15:21:59.228234 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.228156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tqt7r_a6303d73-ea5d-40e9-b1bc-35c6f42ff16a/discovery/0.log" Jul 09 15:21:59.280551 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.280524 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/0.log" Jul 09 15:21:59.309558 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.309534 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/1.log" Jul 09 15:21:59.313139 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.313120 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-756d646c97-dc7nl_c20cbeff-0734-4005-9114-8703dde41fb5/manager/0.log" Jul 09 15:21:59.338712 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.338681 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vzqnz_afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9/payload-pre-processing/0.log" Jul 09 15:21:59.340258 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:21:59.340221 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jl8c5_2fb0a635-e72a-4c02-88d8-5c65d2b33a68/openshift-lws-operator/0.log" Jul 09 15:22:00.607985 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:00.607958 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-695cd9447dqxh48_d20db7f9-bc04-4edf-9b10-cbd4454e9d99/istio-proxy/0.log" Jul 09 15:22:00.699502 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:00.699476 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tqt7r_a6303d73-ea5d-40e9-b1bc-35c6f42ff16a/discovery/0.log" Jul 09 15:22:00.756024 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:00.755994 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/0.log" Jul 09 15:22:00.782335 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:00.782304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-klvl7_05f46522-b1e1-4b1d-80bb-335c21609864/istio-proxy/1.log" Jul 09 15:22:00.813273 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:00.813238 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-vzqnz_afa0752a-cfa6-4adf-83cd-7d0b36cb3cd9/payload-pre-processing/0.log" Jul 09 15:22:04.189216 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:04.189185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qrjj_0af03724-c9a7-4038-a197-a91ca94574b1/migrator/0.log" Jul 09 15:22:04.211170 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:04.211140 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2qrjj_0af03724-c9a7-4038-a197-a91ca94574b1/graceful-termination/0.log" Jul 09 15:22:05.621710 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.621683 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/kube-multus-additional-cni-plugins/0.log" Jul 09 15:22:05.643488 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.643459 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/egress-router-binary-copy/0.log" Jul 09 15:22:05.662977 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.662948 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/cni-plugins/0.log" Jul 09 15:22:05.680826 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.680798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/bond-cni-plugin/0.log" Jul 09 15:22:05.698323 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.698300 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/routeoverride-cni/0.log" Jul 09 15:22:05.718012 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.717989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/whereabouts-cni-bincopy/0.log" Jul 09 15:22:05.736072 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.736050 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7mtbz_48144e0e-3d98-4296-8337-91320890268f/whereabouts-cni/0.log" Jul 09 15:22:05.949323 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:05.949210 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j7n8g_6e8dd422-06e4-4d5c-922a-ee08c3aadfc9/kube-multus/0.log" Jul 09 15:22:06.003654 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:06.003624 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2wzc2_2ccf631e-01f6-4635-8f46-5a410f14643c/network-metrics-daemon/0.log" Jul 09 15:22:06.020671 ip-10-0-140-95 kubenswrapper[2572]: I0709 15:22:06.020646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2wzc2_2ccf631e-01f6-4635-8f46-5a410f14643c/kube-rbac-proxy/0.log"