Jul 09 03:58:15.076930 ip-10-0-132-152 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 03:58:15.076942 ip-10-0-132-152 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 03:58:15.076952 ip-10-0-132-152 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 03:58:15.077270 ip-10-0-132-152 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 03:58:25.326109 ip-10-0-132-152 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 03:58:25.326124 ip-10-0-132-152 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b9173d2b33d144bdb95f128259797183 -- Jul 09 04:00:02.500150 ip-10-0-132-152 systemd[1]: Starting Kubernetes Kubelet... Jul 09 04:00:02.919597 ip-10-0-132-152 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:00:02.919597 ip-10-0-132-152 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 04:00:02.919597 ip-10-0-132-152 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:00:02.919597 ip-10-0-132-152 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 04:00:02.919597 ip-10-0-132-152 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 04:00:02.922254 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.922163 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 04:00:02.928871 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928847 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.928871 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928870 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.928871 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928874 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928877 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928881 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928883 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928886 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928889 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928891 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928894 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928897 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928899 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928901 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928904 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928906 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928909 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928911 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928920 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928923 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928926 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928928 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928930 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.928999 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928933 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928935 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928938 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928940 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928943 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928947 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928949 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928951 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928954 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928956 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928959 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928962 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928967 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928970 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928974 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928977 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928980 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928983 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928985 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928988 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.929466 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928990 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928993 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928996 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.928998 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929001 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929004 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929006 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929009 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929012 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929015 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929017 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929020 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929022 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929025 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929027 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929030 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929033 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929036 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929038 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.929965 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929041 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929043 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929046 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929048 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929051 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929055 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929059 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929064 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929067 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929070 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929073 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929076 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929078 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929081 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929083 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929086 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929088 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929091 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.930437 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929093 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929095 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929098 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929101 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929105 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929108 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929111 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929113 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929116 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929119 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929122 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929124 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929127 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929130 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929133 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929136 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929138 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929141 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929143 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929146 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.930893 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929896 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929904 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929907 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929909 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929912 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929916 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929920 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929924 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929928 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929931 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929933 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929936 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929939 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929941 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929944 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929946 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929949 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929951 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929954 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.931393 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929956 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929959 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929961 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929964 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929966 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929969 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929973 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929975 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929978 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929980 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929983 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929986 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929988 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929991 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929993 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929996 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.929998 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930001 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930003 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930006 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.931863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930009 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930011 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930014 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930016 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930018 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930021 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930023 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930025 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930028 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930030 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930033 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930037 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930040 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930043 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930046 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930049 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930052 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930054 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930057 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.932385 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930060 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930063 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930066 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930069 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930073 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930075 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930078 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930080 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930084 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930087 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930089 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930092 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930094 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930097 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930100 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930102 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930105 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930107 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930109 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930112 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.932872 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930114 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930117 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930119 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930121 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930124 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930126 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930130 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930132 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930135 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930137 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930140 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930143 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930146 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930148 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930151 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930157 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930159 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930162 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930164 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930166 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.933362 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930169 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930572 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930576 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930579 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930582 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930585 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930588 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930590 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930593 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930597 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930600 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930603 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930606 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930608 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930611 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930613 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930616 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930618 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930621 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930623 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.933861 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930626 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930629 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930634 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930637 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930639 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930642 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930644 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930648 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930651 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930653 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930656 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930658 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930661 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930664 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930668 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930671 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930673 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930675 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930678 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.934354 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930681 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930683 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930686 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930689 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930691 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930693 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930696 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930698 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930701 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930703 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930705 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930708 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930710 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930713 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930715 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930719 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930722 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930724 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930726 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930729 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.934868 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930733 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930736 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930738 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930741 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930743 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930746 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930748 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930751 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930754 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930756 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930759 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930761 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930765 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930769 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930771 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930774 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930777 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930779 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930782 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930784 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.935347 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930787 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930789 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930792 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930795 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930797 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930800 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930802 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930806 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930808 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930811 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930814 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930816 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930820 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930839 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930842 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930844 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930847 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930849 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930852 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930854 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.935812 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.930857 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930943 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930955 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930964 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930970 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930977 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930982 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930989 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930995 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.930998 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931001 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931004 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931008 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931010 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931013 2563 flags.go:64] FLAG: --cgroup-root="" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931016 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931019 2563 flags.go:64] FLAG: --client-ca-file="" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931022 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931025 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931032 2563 flags.go:64] FLAG: --cluster-domain="" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931040 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931043 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931046 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931049 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 04:00:02.936297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931054 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931056 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931059 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931062 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931066 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931069 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931071 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931074 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931077 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931081 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931084 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931086 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931089 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931092 2563 flags.go:64] FLAG: --enable-server="true" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931095 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931100 2563 flags.go:64] FLAG: --event-burst="100" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931103 2563 flags.go:64] FLAG: --event-qps="50" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931105 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931108 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931111 2563 flags.go:64] FLAG: --eviction-hard="" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931115 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931117 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931120 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931123 2563 flags.go:64] FLAG: --eviction-soft="" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931126 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 04:00:02.936985 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931128 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931131 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931135 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931137 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931140 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931143 2563 flags.go:64] FLAG: --feature-gates="" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931146 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931149 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931152 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931156 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931158 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931162 2563 flags.go:64] FLAG: --help="false" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931164 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-132-152.ec2.internal" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931167 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931170 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931173 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931176 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931180 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931183 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931185 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931188 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931191 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931195 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931197 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 04:00:02.937595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931200 2563 flags.go:64] FLAG: --kube-reserved="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931203 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931205 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931208 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931211 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931213 2563 flags.go:64] FLAG: --lock-file="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931216 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931219 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931222 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931227 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931231 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931234 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931237 2563 flags.go:64] FLAG: --logging-format="text" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931239 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931242 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931245 2563 flags.go:64] FLAG: --manifest-url="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931248 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931252 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931255 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931259 2563 flags.go:64] FLAG: --max-pods="110" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931262 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931265 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931267 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931270 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931274 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 04:00:02.938201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931277 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931280 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931288 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931291 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931294 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931296 2563 flags.go:64] FLAG: --pod-cidr="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931300 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931306 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931309 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931312 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931315 2563 flags.go:64] FLAG: --port="10250" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931317 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931320 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f31c146b00749476" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931323 2563 flags.go:64] FLAG: --qos-reserved="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931326 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931328 2563 flags.go:64] FLAG: --register-node="true" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931331 2563 flags.go:64] FLAG: --register-with-taints="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931335 2563 flags.go:64] FLAG: --registry-burst="10" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931338 2563 flags.go:64] FLAG: --registry-qps="5" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931341 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931343 2563 flags.go:64] FLAG: --reserved-memory="" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931347 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931350 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931353 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931356 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 04:00:02.938872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931358 2563 flags.go:64] FLAG: --runonce="false" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931361 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931364 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931367 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931369 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931372 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931375 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931378 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931381 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931383 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931386 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931389 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931392 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931395 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931399 2563 flags.go:64] FLAG: --system-cgroups="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931402 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931407 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931409 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931412 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931416 2563 flags.go:64] FLAG: --tls-min-version="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931419 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931422 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931424 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931427 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931431 2563 flags.go:64] FLAG: --v="2" Jul 09 04:00:02.939509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931435 2563 flags.go:64] FLAG: --version="false" Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931439 2563 flags.go:64] FLAG: --vmodule="" Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931442 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.931445 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931607 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931614 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931617 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931620 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931623 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931626 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931629 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931631 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931634 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931636 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931639 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931641 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931644 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931647 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931649 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931652 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.940173 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931654 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931657 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931660 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931663 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931665 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931668 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931670 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931672 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931675 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931677 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931679 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931683 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931686 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931689 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931691 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931696 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931699 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931704 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931706 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.940656 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931709 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931711 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931714 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931716 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931719 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931721 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931723 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931726 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931728 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931731 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931733 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931736 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931738 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931741 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931743 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931746 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931748 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931751 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931753 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.941146 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931756 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931758 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931760 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931763 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931765 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931769 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931771 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931773 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931776 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931778 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931781 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931784 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931786 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931789 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931791 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931794 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931796 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931799 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931801 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931804 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.941642 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931807 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931811 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931814 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931816 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931820 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931838 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931841 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931844 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931847 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931850 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931853 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931856 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931859 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931862 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931865 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931868 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931871 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931875 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931877 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931880 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.942150 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931883 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931886 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931889 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931893 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.931895 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.933529 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.940631 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.940649 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.940669 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.940674 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940746 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940752 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940756 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940759 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940762 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.942644 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940765 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940768 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940770 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940775 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940778 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940781 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940784 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940796 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940799 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940802 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940805 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940808 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940810 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940813 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940816 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940820 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940837 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940841 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.943038 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940843 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940846 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940849 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940851 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940854 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940856 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940860 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940862 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940865 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940868 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940870 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940873 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940876 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940878 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940881 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940884 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940886 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940889 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940891 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940894 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.943464 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940896 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940899 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940907 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940909 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940912 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940914 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940917 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940919 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940921 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940924 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940926 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940929 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940931 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940933 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940936 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940938 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940941 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940943 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940946 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940949 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.944065 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940952 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940954 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940957 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940959 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940961 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940964 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940966 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940969 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940971 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940974 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940976 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940979 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940981 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940983 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940985 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940995 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.940998 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941000 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941003 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941005 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.944555 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941007 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941010 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941012 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941015 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941018 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941021 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941023 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941025 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941028 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941030 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941034 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941036 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941041 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941047 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.945256 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941050 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.941055 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941209 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941214 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941217 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941220 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941222 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941225 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941228 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941230 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941233 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941236 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941238 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941246 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941249 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 04:00:02.945637 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941252 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941254 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941257 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941259 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941263 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941266 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941269 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941271 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941274 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941276 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941279 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941281 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941284 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941287 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941289 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941291 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941294 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941296 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941299 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 04:00:02.946022 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941302 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941306 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941308 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941311 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941314 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941317 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941319 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941322 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941324 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941327 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941329 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941332 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941339 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941342 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941344 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941347 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941349 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941352 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941354 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941356 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 04:00:02.946492 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941359 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941361 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941364 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941366 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941369 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941372 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941374 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941376 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941379 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941381 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941384 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941386 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941389 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941391 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941394 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941396 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941399 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941401 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941405 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 04:00:02.947026 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941407 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941410 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941412 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941415 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941417 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941420 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941427 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941430 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941432 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941434 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941437 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941440 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941442 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941444 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941452 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941455 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941457 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941460 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941463 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 04:00:02.947483 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941465 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941467 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941469 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941472 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941474 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941477 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941479 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941482 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:02.941484 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.941489 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.941612 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 04:00:02.947952 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.947907 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 04:00:02.949412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.949400 2563 server.go:1019] "Starting client certificate rotation" Jul 09 04:00:02.949518 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.949501 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:00:02.949547 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.949536 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 04:00:02.951772 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.951759 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:00:02.952972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.952954 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 04:00:02.966420 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.966400 2563 log.go:25] "Validated CRI v1 runtime API" Jul 09 04:00:02.968414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.968397 2563 log.go:25] "Validated CRI v1 image API" Jul 09 04:00:02.970359 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.970342 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 04:00:02.972544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.972518 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b66ba03-86af-4895-a1e7-eb329bc9f9e9:/dev/nvme0n1p4 eca0487d-d22f-499d-b696-fa03ab3b2cd6:/dev/nvme0n1p3] Jul 09 04:00:02.972608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.972543 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 04:00:02.978040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.977931 2563 manager.go:216] Machine: {Timestamp:2026-07-09 04:00:02.976616463 +0000 UTC m=+0.352447518 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100138 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a80b520b6cbd6f9390af400e345a2 SystemUUID:ec2a80b5-20b6-cbd6-f939-0af400e345a2 BootID:b9173d2b-33d1-44bd-b95f-128259797183 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:b0:e0:ae:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:b0:e0:ae:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:48:06:ce:81:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 04:00:02.978040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.978037 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 04:00:02.978146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.978131 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 04:00:02.978307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.978285 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:00:02.981236 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.981214 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 04:00:02.981372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.981240 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 04:00:02.981960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.981950 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 04:00:02.981995 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.981963 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 04:00:02.981995 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.981970 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:00:02.982504 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.982492 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 04:00:02.983837 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.983815 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 04:00:02.986762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986750 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:00:02.986903 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986893 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 04:00:02.986933 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986925 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 09 04:00:02.986966 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986935 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 04:00:02.986966 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986949 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 04:00:02.986966 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986958 2563 kubelet.go:398] "Adding apiserver pod source" Jul 09 04:00:02.987061 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.986968 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 04:00:02.987947 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.987921 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:00:02.988042 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.987956 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 04:00:02.990263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.990241 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 04:00:02.992115 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.992102 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 04:00:02.992172 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.992132 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 04:00:02.993437 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993426 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993442 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993449 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993454 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993463 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993468 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993477 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993485 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993495 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993501 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993509 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 04:00:02.993510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.993515 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 04:00:02.995225 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.995213 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 04:00:02.995271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.995227 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 04:00:02.998732 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.998715 2563 server.go:1268] "Started kubelet" Jul 09 04:00:02.998860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.998799 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 04:00:02.998966 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.998844 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 04:00:02.999020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.998848 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 04:00:02.999062 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:02.999048 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 04:00:02.999658 ip-10-0-132-152 systemd[1]: Started Kubernetes Kubelet. Jul 09 04:00:03.000031 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.000016 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 09 04:00:03.000315 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.000292 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 04:00:03.000477 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.000457 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 04:00:03.000517 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.000459 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 04:00:03.001769 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.001749 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ps7zh" Jul 09 04:00:03.005237 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.005209 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 04:00:03.006176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.006162 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 04:00:03.006247 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.006197 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 04:00:03.006287 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.006250 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.006910 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.006886 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 04:00:03.006910 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.006887 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 04:00:03.007034 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.006926 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 04:00:03.007091 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007074 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 09 04:00:03.007091 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007087 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 09 04:00:03.007343 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.006212 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-152.ec2.internal.18c0831aaaebe0c0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-152.ec2.internal,UID:ip-10-0-132-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-152.ec2.internal,},FirstTimestamp:2026-07-09 04:00:02.998689984 +0000 UTC m=+0.374521039,LastTimestamp:2026-07-09 04:00:02.998689984 +0000 UTC m=+0.374521039,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-152.ec2.internal,}" Jul 09 04:00:03.007633 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007617 2563 factory.go:153] Registering CRI-O factory Jul 09 04:00:03.007633 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007633 2563 factory.go:223] Registration of the crio container factory successfully Jul 09 04:00:03.007768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007680 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 04:00:03.007768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007687 2563 factory.go:55] Registering systemd factory Jul 09 04:00:03.007768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007692 2563 factory.go:223] Registration of the systemd container factory successfully Jul 09 04:00:03.007768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007713 2563 factory.go:103] Registering Raw factory Jul 09 04:00:03.007768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.007725 2563 manager.go:1196] Started watching for new ooms in manager Jul 09 04:00:03.008397 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.008374 2563 manager.go:349] Starting recovery of all containers Jul 09 04:00:03.009408 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.009371 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ps7zh" Jul 09 04:00:03.011241 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.011212 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 04:00:03.011763 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.011736 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 04:00:03.020460 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.020297 2563 manager.go:354] Recovery completed Jul 09 04:00:03.024563 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.024547 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.026755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.026733 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.026894 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.026776 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.026894 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.026790 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.027357 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.027345 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 04:00:03.027357 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.027356 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 04:00:03.027441 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.027364 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.027441 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.027372 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 09 04:00:03.028113 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028096 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.028176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028125 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.028176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028135 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.028753 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028743 2563 policy_none.go:49] "None policy: Start" Jul 09 04:00:03.028782 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028759 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 04:00:03.028782 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.028769 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 04:00:03.029740 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.029729 2563 policy_none.go:47] "Start" Jul 09 04:00:03.074584 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.074547 2563 manager.go:337] "Starting Device Plugin manager" Jul 09 04:00:03.074584 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.074591 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.074601 2563 server.go:87] "Starting device plugin registration server" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.074891 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.074905 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.075158 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.075228 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.075236 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.075787 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 04:00:03.091640 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.075854 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.126022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.125983 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 04:00:03.127366 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.127339 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 04:00:03.127487 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.127387 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 04:00:03.127487 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.127417 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 04:00:03.127487 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.127464 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 04:00:03.129923 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.129903 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:03.176040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.175940 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.177184 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.177165 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.177275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.177199 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.177275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.177210 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.177275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.177240 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.183889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.183859 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.183889 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.183890 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-152.ec2.internal\": node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.196876 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.196846 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.227731 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.227678 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"] Jul 09 04:00:03.227917 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.227762 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.228703 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.228684 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.228813 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.228721 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.228813 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.228736 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.229967 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.229953 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.230081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.230128 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230113 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.230701 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230682 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.230790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230707 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.230790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230719 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.230790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230726 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.230790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230734 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.230790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.230739 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.231932 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.231919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.231992 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.231946 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 04:00:03.232620 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.232605 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientMemory" Jul 09 04:00:03.232682 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.232628 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 04:00:03.232682 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.232641 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeHasSufficientPID" Jul 09 04:00:03.247376 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.247356 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-152.ec2.internal\" not found" node="ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.251382 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.251369 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-152.ec2.internal\" not found" node="ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.296959 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.296931 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.308307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.308275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51acc6f74353a35d5f168e3015e79515-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"51acc6f74353a35d5f168e3015e79515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.308307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.308316 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.308431 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.308337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.397913 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.397881 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.409319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409295 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51acc6f74353a35d5f168e3015e79515-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"51acc6f74353a35d5f168e3015e79515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.409319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51acc6f74353a35d5f168e3015e79515-config\") pod \"kube-apiserver-proxy-ip-10-0-132-152.ec2.internal\" (UID: \"51acc6f74353a35d5f168e3015e79515\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.409403 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.409435 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409401 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.409435 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.409490 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.409433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc1167e7e8dc7b8789dca3288b9765d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal\" (UID: \"ffc1167e7e8dc7b8789dca3288b9765d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.498786 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.498712 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.551339 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.551301 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.553856 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.553839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:03.599116 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.599083 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.699606 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.699574 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.800207 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.800175 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.811872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.811850 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:03.900379 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:03.900348 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-152.ec2.internal\" not found" Jul 09 04:00:03.948928 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.948898 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 04:00:03.949486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.949052 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 04:00:03.949486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.949090 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 04:00:03.981543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.981517 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:03.987757 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.987737 2563 apiserver.go:52] "Watching apiserver" Jul 09 04:00:03.997704 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.997678 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 04:00:03.998045 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.998023 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2xs9c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r","openshift-multus/multus-additional-cni-plugins-hxd6f","openshift-multus/network-metrics-daemon-rmwnt","openshift-network-operator/iptables-alerter-l9k9m","openshift-cluster-node-tuning-operator/tuned-clxk6","openshift-dns/node-resolver-lw67f","openshift-image-registry/node-ca-cblsd","openshift-multus/multus-vkj7n","openshift-network-diagnostics/network-check-target-7kvjw","openshift-ovn-kubernetes/ovnkube-node-dbv6k","kube-system/global-pull-secret-syncer-9c5rl"] Jul 09 04:00:03.999603 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:03.999582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.000737 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.000720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.002008 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.001987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.002214 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.002172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 04:00:04.002287 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.002171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x8fpb\"" Jul 09 04:00:04.002421 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.002406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 04:00:04.003156 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.003140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 04:00:04.003381 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.003367 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.003433 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.003378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.003468 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.003449 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:04.003558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.003539 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ftz8r\"" Jul 09 04:00:04.003609 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.003567 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.004323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004302 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 04:00:04.004422 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004407 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7jbbn\"" Jul 09 04:00:04.004506 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004441 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.004556 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004478 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 04:00:04.004655 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 04:00:04.004724 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004709 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.004767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.004713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.006180 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.006163 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.006390 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.006373 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 04:00:04.006443 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.006382 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" Jul 09 04:00:04.007040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.007025 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.007185 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.007169 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.007383 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.007367 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 04:00:04.007452 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.007439 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8q8zp\"" Jul 09 04:00:04.008528 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.008511 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.008644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.008576 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.008644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.008588 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ssm2l\"" Jul 09 04:00:04.008847 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.008819 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.010168 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.010146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.011093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.011078 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.011272 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.011256 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.011340 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.011292 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d88sv\"" Jul 09 04:00:04.011758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.011746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.012399 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012382 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.012476 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wxmsm\"" Jul 09 04:00:04.012476 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012388 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 04:00:04.012686 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012672 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.012922 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75qq\" (UniqueName: \"kubernetes.io/projected/89a730a1-1a58-43e0-9b37-ff864cc4143c-kube-api-access-x75qq\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.013011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012926 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-kubernetes\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-conf\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-hosts-file\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.013011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.012988 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013021 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5l4g\" (UniqueName: \"kubernetes.io/projected/7ec00541-a6a5-47e5-a1cc-14185bedfc23-kube-api-access-d5l4g\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-modprobe-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-konnectivity-ca\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-socket-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-registration-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013160 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a730a1-1a58-43e0-9b37-ff864cc4143c-host-slash\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.013231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-lib-modules\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-tmp\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4vx\" (UniqueName: \"kubernetes.io/projected/b73f5423-f909-48e8-bd78-e513dce89b29-kube-api-access-tr4vx\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-os-release\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzwr4\" (UniqueName: \"kubernetes.io/projected/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-kube-api-access-hzwr4\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-device-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-sys-fs\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-var-lib-kubelet\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-cnibin\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6mhs\" (UniqueName: \"kubernetes.io/projected/618acde9-2f54-45b6-9c8a-b93383698ef2-kube-api-access-h6mhs\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a730a1-1a58-43e0-9b37-ff864cc4143c-iptables-alerter-script\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-agent-certs\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccp9b\" (UniqueName: \"kubernetes.io/projected/c47103b7-74f0-4807-ba24-27be90ea4805-kube-api-access-ccp9b\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013660 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 03:55:03 +0000 UTC" deadline="2028-01-12 12:42:37.58343047 +0000 UTC" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013682 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13256h42m33.569751419s" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-systemd\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-run\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-etc-tuned\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.013906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysconfig\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.014351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-tmp-dir\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.014351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-sys\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.014351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.013972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-host\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.014351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.014023 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 04:00:04.014351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.014043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xgrpj\"" Jul 09 04:00:04.015062 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.014581 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:04.015062 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.014635 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:04.018315 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.017057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.018315 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.018276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.018433 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.018352 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:04.018963 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.018941 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:00:04.019053 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.019019 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" Jul 09 04:00:04.019153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.019131 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal"] Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020130 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020187 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020206 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020272 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020136 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020309 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 04:00:04.020659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.020530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-928c7\"" Jul 09 04:00:04.021036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.021021 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 04:00:04.028066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.028037 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 04:00:04.028418 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.028385 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal"] Jul 09 04:00:04.032451 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.032431 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:04.037994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.037976 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ngmz" Jul 09 04:00:04.047595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.047574 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ngmz" Jul 09 04:00:04.108454 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.108429 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 04:00:04.112933 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.112902 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc1167e7e8dc7b8789dca3288b9765d.slice/crio-df246d42c227665c386b8af03171707e99fa79bd0ed8c92773cd53bfaec4b31b WatchSource:0}: Error finding container df246d42c227665c386b8af03171707e99fa79bd0ed8c92773cd53bfaec4b31b: Status 404 returned error can't find the container with id df246d42c227665c386b8af03171707e99fa79bd0ed8c92773cd53bfaec4b31b Jul 09 04:00:04.115195 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115174 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.115264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-systemd\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.115264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-k8s-cni-cncf-io\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.115354 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.115354 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115297 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysconfig\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.115354 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16746381-a780-4428-be80-fa590d45f7ee-serviceca\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.115354 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115361 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-systemd\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75qq\" (UniqueName: \"kubernetes.io/projected/89a730a1-1a58-43e0-9b37-ff864cc4143c-kube-api-access-x75qq\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-kubernetes\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-kubelet-config\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysconfig\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-bin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.115541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-multus-certs\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115567 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-kubernetes\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-modprobe-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-system-cni-dir\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-registration-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/519c1872-7de3-4c69-abbb-83251c7fadb2-ovn-node-metrics-cert\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-dbus\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-modprobe-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115796 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-registration-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115865 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-config\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-script-lib\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-os-release\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-hostroot\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.115986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-os-release\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzwr4\" (UniqueName: \"kubernetes.io/projected/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-kube-api-access-hzwr4\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-os-release\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-sys-fs\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-sys-fs\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-slash\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-netns\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-binary-copy\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-var-lib-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-var-lib-kubelet\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-cnibin\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/618acde9-2f54-45b6-9c8a-b93383698ef2-cnibin\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.116820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-var-lib-kubelet\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116390 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6mhs\" (UniqueName: \"kubernetes.io/projected/618acde9-2f54-45b6-9c8a-b93383698ef2-kube-api-access-h6mhs\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-agent-certs\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccp9b\" (UniqueName: \"kubernetes.io/projected/c47103b7-74f0-4807-ba24-27be90ea4805-kube-api-access-ccp9b\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-node-log\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-cni-binary-copy\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116493 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116528 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-ovn\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5hq\" (UniqueName: \"kubernetes.io/projected/519c1872-7de3-4c69-abbb-83251c7fadb2-kube-api-access-2n5hq\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gxk\" (UniqueName: \"kubernetes.io/projected/16746381-a780-4428-be80-fa590d45f7ee-kube-api-access-f4gxk\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.116605 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.116669 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:04.616647859 +0000 UTC m=+1.992478926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-netns\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.117640 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-run\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116958 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-run\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.116987 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117014 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-d\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117060 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-etc-tuned\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117082 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16746381-a780-4428-be80-fa590d45f7ee-host\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-conf-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-tmp-dir\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-multus-daemon-config\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-sys\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-host\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-conf\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-hosts-file\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117408 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/618acde9-2f54-45b6-9c8a-b93383698ef2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-tmp-dir\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117481 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-etc-sysctl-conf\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.118291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117508 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-hosts-file\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.119089 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-log-socket\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.119089 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-sys\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.119089 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-host\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.119089 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.117641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-system-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5l4g\" (UniqueName: \"kubernetes.io/projected/7ec00541-a6a5-47e5-a1cc-14185bedfc23-kube-api-access-d5l4g\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-konnectivity-ca\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-socket-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-systemd-units\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119514 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-systemd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-multus\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119570 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a730a1-1a58-43e0-9b37-ff864cc4143c-host-slash\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-lib-modules\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-tmp\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4vx\" (UniqueName: \"kubernetes.io/projected/b73f5423-f909-48e8-bd78-e513dce89b29-kube-api-access-tr4vx\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-kubelet\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-device-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-netd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-env-overrides\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-etc-kubernetes\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8bv\" (UniqueName: \"kubernetes.io/projected/8f165785-2bea-4425-a941-20a9fe239172-kube-api-access-fv8bv\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.120539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a730a1-1a58-43e0-9b37-ff864cc4143c-iptables-alerter-script\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-kubelet\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.119979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-etc-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-bin\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-cnibin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-socket-dir-parent\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-device-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47103b7-74f0-4807-ba24-27be90ea4805-socket-dir\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b73f5423-f909-48e8-bd78-e513dce89b29-lib-modules\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.120969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-agent-certs\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.121022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bb65c651-889f-43d7-bb05-1f9e0b7e41a6-konnectivity-ca\") pod \"konnectivity-agent-2xs9c\" (UID: \"bb65c651-889f-43d7-bb05-1f9e0b7e41a6\") " pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.121036 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89a730a1-1a58-43e0-9b37-ff864cc4143c-iptables-alerter-script\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.121183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89a730a1-1a58-43e0-9b37-ff864cc4143c-host-slash\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.122432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.122013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-etc-tuned\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.123161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.122848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b73f5423-f909-48e8-bd78-e513dce89b29-tmp\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.123161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.122860 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:00:04.130577 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.130545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6mhs\" (UniqueName: \"kubernetes.io/projected/618acde9-2f54-45b6-9c8a-b93383698ef2-kube-api-access-h6mhs\") pod \"multus-additional-cni-plugins-hxd6f\" (UID: \"618acde9-2f54-45b6-9c8a-b93383698ef2\") " pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.130687 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.130637 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75qq\" (UniqueName: \"kubernetes.io/projected/89a730a1-1a58-43e0-9b37-ff864cc4143c-kube-api-access-x75qq\") pod \"iptables-alerter-l9k9m\" (UID: \"89a730a1-1a58-43e0-9b37-ff864cc4143c\") " pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.131018 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.130999 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccp9b\" (UniqueName: \"kubernetes.io/projected/c47103b7-74f0-4807-ba24-27be90ea4805-kube-api-access-ccp9b\") pod \"aws-ebs-csi-driver-node-lgg4r\" (UID: \"c47103b7-74f0-4807-ba24-27be90ea4805\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.131263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.131211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"ffc1167e7e8dc7b8789dca3288b9765d","Type":"ContainerStarted","Data":"df246d42c227665c386b8af03171707e99fa79bd0ed8c92773cd53bfaec4b31b"} Jul 09 04:00:04.132024 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.132007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5l4g\" (UniqueName: \"kubernetes.io/projected/7ec00541-a6a5-47e5-a1cc-14185bedfc23-kube-api-access-d5l4g\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.132418 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.132399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzwr4\" (UniqueName: \"kubernetes.io/projected/1b8ede72-26f2-4e07-a7cc-646b9d0e3abf-kube-api-access-hzwr4\") pod \"node-resolver-lw67f\" (UID: \"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf\") " pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.132756 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.132739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4vx\" (UniqueName: \"kubernetes.io/projected/b73f5423-f909-48e8-bd78-e513dce89b29-kube-api-access-tr4vx\") pod \"tuned-clxk6\" (UID: \"b73f5423-f909-48e8-bd78-e513dce89b29\") " pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.220455 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-cni-binary-copy\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-ovn\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5hq\" (UniqueName: \"kubernetes.io/projected/519c1872-7de3-4c69-abbb-83251c7fadb2-kube-api-access-2n5hq\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220505 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gxk\" (UniqueName: \"kubernetes.io/projected/16746381-a780-4428-be80-fa590d45f7ee-kube-api-access-f4gxk\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-netns\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220544 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-ovn\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16746381-a780-4428-be80-fa590d45f7ee-host\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/16746381-a780-4428-be80-fa590d45f7ee-host\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-netns\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.220646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-conf-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-multus-daemon-config\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-log-socket\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.220730 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-system-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-systemd-units\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-conf-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-systemd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-log-socket\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.220846 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:04.720809995 +0000 UTC m=+2.096641037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-systemd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-system-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-multus\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-systemd-units\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-multus\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-kubelet\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-netd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-kubelet\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.220992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-env-overrides\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-etc-kubernetes\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-netd\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-etc-kubernetes\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-cni-binary-copy\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8bv\" (UniqueName: \"kubernetes.io/projected/8f165785-2bea-4425-a941-20a9fe239172-kube-api-access-fv8bv\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-kubelet\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-etc-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221208 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-kubelet\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-bin\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221247 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-etc-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-cnibin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-socket-dir-parent\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221287 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-cnibin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-k8s-cni-cncf-io\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.221943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-cni-bin\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-socket-dir-parent\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16746381-a780-4428-be80-fa590d45f7ee-serviceca\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-k8s-cni-cncf-io\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-multus-cni-dir\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-kubelet-config\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-bin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221434 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-kubelet-config\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-multus-certs\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221460 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-var-lib-cni-bin\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-env-overrides\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f165785-2bea-4425-a941-20a9fe239172-multus-daemon-config\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/519c1872-7de3-4c69-abbb-83251c7fadb2-ovn-node-metrics-cert\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-host-run-multus-certs\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-dbus\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221521 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-run-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.222554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221540 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221566 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-config\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-script-lib\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221626 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64a11f65-1fb8-4a92-8f1c-a37df9602807-dbus\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-os-release\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-ovn-kubernetes\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-hostroot\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-os-release\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221662 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/16746381-a780-4428-be80-fa590d45f7ee-serviceca\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-slash\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f165785-2bea-4425-a941-20a9fe239172-hostroot\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221772 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-netns\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-slash\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-var-lib-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-host-run-netns\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-node-log\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221874 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-var-lib-openvswitch\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223540 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.221889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/519c1872-7de3-4c69-abbb-83251c7fadb2-node-log\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223540 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.222083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-config\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223540 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.222169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/519c1872-7de3-4c69-abbb-83251c7fadb2-ovnkube-script-lib\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.223817 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.223800 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/519c1872-7de3-4c69-abbb-83251c7fadb2-ovn-node-metrics-cert\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.229390 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.229313 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:04.229390 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.229340 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:04.229390 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.229352 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:04.229605 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.229414 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:04.729397064 +0000 UTC m=+2.105228107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:04.231025 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.231005 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5hq\" (UniqueName: \"kubernetes.io/projected/519c1872-7de3-4c69-abbb-83251c7fadb2-kube-api-access-2n5hq\") pod \"ovnkube-node-dbv6k\" (UID: \"519c1872-7de3-4c69-abbb-83251c7fadb2\") " pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.231413 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.231393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gxk\" (UniqueName: \"kubernetes.io/projected/16746381-a780-4428-be80-fa590d45f7ee-kube-api-access-f4gxk\") pod \"node-ca-cblsd\" (UID: \"16746381-a780-4428-be80-fa590d45f7ee\") " pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.231466 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.231453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8bv\" (UniqueName: \"kubernetes.io/projected/8f165785-2bea-4425-a941-20a9fe239172-kube-api-access-fv8bv\") pod \"multus-vkj7n\" (UID: \"8f165785-2bea-4425-a941-20a9fe239172\") " pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.333448 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.333360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:04.344328 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.344296 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb65c651_889f_43d7_bb05_1f9e0b7e41a6.slice/crio-47f3c15eda8308b8a301c2a7e0f6aaf2919eabd8fcb687f4c3ddb19ade4b294f WatchSource:0}: Error finding container 47f3c15eda8308b8a301c2a7e0f6aaf2919eabd8fcb687f4c3ddb19ade4b294f: Status 404 returned error can't find the container with id 47f3c15eda8308b8a301c2a7e0f6aaf2919eabd8fcb687f4c3ddb19ade4b294f Jul 09 04:00:04.354819 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.354800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" Jul 09 04:00:04.358579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.358559 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" Jul 09 04:00:04.362194 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.362169 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47103b7_74f0_4807_ba24_27be90ea4805.slice/crio-99a4a3dfb6dcd062542082bec489cb944ac54d17bed2a15177bf12b7cc6b51a0 WatchSource:0}: Error finding container 99a4a3dfb6dcd062542082bec489cb944ac54d17bed2a15177bf12b7cc6b51a0: Status 404 returned error can't find the container with id 99a4a3dfb6dcd062542082bec489cb944ac54d17bed2a15177bf12b7cc6b51a0 Jul 09 04:00:04.366636 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.366612 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618acde9_2f54_45b6_9c8a_b93383698ef2.slice/crio-7a3ae2893d794e8d980344148f0960387fe8dd0306211c700f34f4f2f5d1e9b9 WatchSource:0}: Error finding container 7a3ae2893d794e8d980344148f0960387fe8dd0306211c700f34f4f2f5d1e9b9: Status 404 returned error can't find the container with id 7a3ae2893d794e8d980344148f0960387fe8dd0306211c700f34f4f2f5d1e9b9 Jul 09 04:00:04.370149 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.370133 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l9k9m" Jul 09 04:00:04.377655 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.377634 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a730a1_1a58_43e0_9b37_ff864cc4143c.slice/crio-22003aa5a8b9d2fecc987ea40796e0e1237e9fa3e931535e6bffb979f203f630 WatchSource:0}: Error finding container 22003aa5a8b9d2fecc987ea40796e0e1237e9fa3e931535e6bffb979f203f630: Status 404 returned error can't find the container with id 22003aa5a8b9d2fecc987ea40796e0e1237e9fa3e931535e6bffb979f203f630 Jul 09 04:00:04.398181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.398151 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-clxk6" Jul 09 04:00:04.405768 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.405743 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73f5423_f909_48e8_bd78_e513dce89b29.slice/crio-34d8f9757f24e641adfcd8782941e7925955990eafaffc98bfafb88f25d1a98a WatchSource:0}: Error finding container 34d8f9757f24e641adfcd8782941e7925955990eafaffc98bfafb88f25d1a98a: Status 404 returned error can't find the container with id 34d8f9757f24e641adfcd8782941e7925955990eafaffc98bfafb88f25d1a98a Jul 09 04:00:04.417913 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.417882 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw67f" Jul 09 04:00:04.425223 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.425198 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8ede72_26f2_4e07_a7cc_646b9d0e3abf.slice/crio-70de5bebc0a3497a464dcfb39783b93d06ab12817ffcd02626eb9056c6eb5595 WatchSource:0}: Error finding container 70de5bebc0a3497a464dcfb39783b93d06ab12817ffcd02626eb9056c6eb5595: Status 404 returned error can't find the container with id 70de5bebc0a3497a464dcfb39783b93d06ab12817ffcd02626eb9056c6eb5595 Jul 09 04:00:04.437243 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.437222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cblsd" Jul 09 04:00:04.443214 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.443196 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vkj7n" Jul 09 04:00:04.444652 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.444619 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16746381_a780_4428_be80_fa590d45f7ee.slice/crio-fde819e87e5cf4ce898afceef6c78d2abf4f9b578f9110d1be445db7d42a0bce WatchSource:0}: Error finding container fde819e87e5cf4ce898afceef6c78d2abf4f9b578f9110d1be445db7d42a0bce: Status 404 returned error can't find the container with id fde819e87e5cf4ce898afceef6c78d2abf4f9b578f9110d1be445db7d42a0bce Jul 09 04:00:04.447964 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.447945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:04.460850 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.458746 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519c1872_7de3_4c69_abbb_83251c7fadb2.slice/crio-c2154a5caf83074e12d22d98859834a2bd3347ba8e87b949a36bae67604ac550 WatchSource:0}: Error finding container c2154a5caf83074e12d22d98859834a2bd3347ba8e87b949a36bae67604ac550: Status 404 returned error can't find the container with id c2154a5caf83074e12d22d98859834a2bd3347ba8e87b949a36bae67604ac550 Jul 09 04:00:04.549153 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:04.549120 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51acc6f74353a35d5f168e3015e79515.slice/crio-dd2431123eeb0f59d4b01f3be99be9bbf2e70a6b1d11f9e62ab1edad071bb3fc WatchSource:0}: Error finding container dd2431123eeb0f59d4b01f3be99be9bbf2e70a6b1d11f9e62ab1edad071bb3fc: Status 404 returned error can't find the container with id dd2431123eeb0f59d4b01f3be99be9bbf2e70a6b1d11f9e62ab1edad071bb3fc Jul 09 04:00:04.624653 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.624556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:04.624789 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.624678 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:04.624789 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.624730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:05.624715806 +0000 UTC m=+3.000546848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:04.725323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.725281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:04.725499 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.725435 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:04.725553 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.725502 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:05.725483252 +0000 UTC m=+3.101314294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:04.826527 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.826477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:04.826675 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.826650 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:04.826675 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.826670 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:04.826784 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.826683 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:04.826784 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:04.826748 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:05.826728688 +0000 UTC m=+3.202559738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:04.957209 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:04.957132 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:05.050180 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.050100 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:55:04 +0000 UTC" deadline="2028-03-02 15:33:03.928692199 +0000 UTC" Jul 09 04:00:05.050180 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.050175 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14459h32m58.878521226s" Jul 09 04:00:05.140052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.140011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" event={"ID":"51acc6f74353a35d5f168e3015e79515","Type":"ContainerStarted","Data":"dd2431123eeb0f59d4b01f3be99be9bbf2e70a6b1d11f9e62ab1edad071bb3fc"} Jul 09 04:00:05.145798 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.144952 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"c2154a5caf83074e12d22d98859834a2bd3347ba8e87b949a36bae67604ac550"} Jul 09 04:00:05.151717 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.151688 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l9k9m" event={"ID":"89a730a1-1a58-43e0-9b37-ff864cc4143c","Type":"ContainerStarted","Data":"22003aa5a8b9d2fecc987ea40796e0e1237e9fa3e931535e6bffb979f203f630"} Jul 09 04:00:05.153300 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.153269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerStarted","Data":"7a3ae2893d794e8d980344148f0960387fe8dd0306211c700f34f4f2f5d1e9b9"} Jul 09 04:00:05.156339 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.156305 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" event={"ID":"c47103b7-74f0-4807-ba24-27be90ea4805","Type":"ContainerStarted","Data":"99a4a3dfb6dcd062542082bec489cb944ac54d17bed2a15177bf12b7cc6b51a0"} Jul 09 04:00:05.159452 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.159422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xs9c" event={"ID":"bb65c651-889f-43d7-bb05-1f9e0b7e41a6","Type":"ContainerStarted","Data":"47f3c15eda8308b8a301c2a7e0f6aaf2919eabd8fcb687f4c3ddb19ade4b294f"} Jul 09 04:00:05.161251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.161190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkj7n" event={"ID":"8f165785-2bea-4425-a941-20a9fe239172","Type":"ContainerStarted","Data":"89fd1f02ac71913d7cdc1762e253f5e12ab5896c6b99e13e157d81e4cc3e562b"} Jul 09 04:00:05.165492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.165417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cblsd" event={"ID":"16746381-a780-4428-be80-fa590d45f7ee","Type":"ContainerStarted","Data":"fde819e87e5cf4ce898afceef6c78d2abf4f9b578f9110d1be445db7d42a0bce"} Jul 09 04:00:05.173560 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.173467 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw67f" event={"ID":"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf","Type":"ContainerStarted","Data":"70de5bebc0a3497a464dcfb39783b93d06ab12817ffcd02626eb9056c6eb5595"} Jul 09 04:00:05.177868 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.177820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-clxk6" event={"ID":"b73f5423-f909-48e8-bd78-e513dce89b29","Type":"ContainerStarted","Data":"34d8f9757f24e641adfcd8782941e7925955990eafaffc98bfafb88f25d1a98a"} Jul 09 04:00:05.635166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.635131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:05.635350 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.635285 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:05.635420 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.635355 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:07.635336078 +0000 UTC m=+5.011167125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:05.735974 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.735923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:05.736169 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.736152 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:05.736256 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.736220 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:07.736199838 +0000 UTC m=+5.112030883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:05.837478 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:05.837439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:05.837650 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.837625 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:05.837650 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.837648 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:05.837758 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.837662 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:05.837758 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:05.837719 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:07.837701306 +0000 UTC m=+5.213532351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:06.050762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.050717 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:55:04 +0000 UTC" deadline="2028-01-15 20:33:31.219699171 +0000 UTC" Jul 09 04:00:06.050762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.050761 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13336h33m25.168942952s" Jul 09 04:00:06.128076 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.128045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:06.128236 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:06.128182 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:06.128609 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.128583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:06.128704 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:06.128683 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:06.128761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.128746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:06.128857 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:06.128821 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:06.379402 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:06.379314 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 04:00:07.653570 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:07.652697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:07.653570 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.653162 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:07.653570 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.653226 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:11.653207508 +0000 UTC m=+9.029038555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:07.754648 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:07.753973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:07.754648 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.754105 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:07.754648 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.754195 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:11.754176961 +0000 UTC m=+9.130008007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:07.855808 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:07.855112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:07.855808 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.855336 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:07.855808 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.855358 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:07.855808 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.855381 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:07.855808 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:07.855439 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:11.855421159 +0000 UTC m=+9.231252204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:08.128070 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:08.128033 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:08.128274 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:08.128181 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:08.128575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:08.128553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:08.128694 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:08.128656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:08.128759 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:08.128699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:08.128805 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:08.128760 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:10.128630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:10.128591 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:10.129103 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:10.128714 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:10.129103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:10.128613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:10.129103 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:10.128817 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:10.129103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:10.128605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:10.129103 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:10.128892 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:11.685372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:11.685240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:11.685812 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.685420 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:11.685812 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.685497 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:19.685480479 +0000 UTC m=+17.061311524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:11.786131 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:11.786093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:11.786309 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.786221 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:11.786309 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.786290 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:19.78627129 +0000 UTC m=+17.162102336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:11.886906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:11.886782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:11.887056 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.886962 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:11.887056 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.886992 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:11.887056 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.887007 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:11.887183 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:11.887067 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:19.887046273 +0000 UTC m=+17.262877320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:12.128077 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:12.128048 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:12.128237 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:12.128083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:12.128237 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:12.128157 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:12.128237 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:12.128051 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:12.128412 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:12.128277 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:12.128412 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:12.128357 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:14.128607 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:14.128743 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:14.129168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:14.129265 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:14.129322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:14.129477 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:14.129388 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:16.128322 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:16.128291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:16.128322 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:16.128320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:16.128849 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:16.128421 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:16.128849 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:16.128788 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:16.128962 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:16.128915 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:16.129016 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:16.128999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:18.127670 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:18.127625 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:18.127670 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:18.127654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:18.128214 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:18.127625 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:18.128214 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:18.127745 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:18.128214 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:18.127791 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:18.128214 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:18.127873 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:19.747356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:19.747326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:19.747844 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.747460 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:19.747844 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.747523 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:35.747502383 +0000 UTC m=+33.123333425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:19.848558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:19.848516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:19.848733 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.848665 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:19.848795 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.848737 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:35.848715655 +0000 UTC m=+33.224546701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:19.949964 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:19.949927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:19.950115 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.950070 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:19.950115 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.950091 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:19.950115 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.950105 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:19.950257 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:19.950167 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:35.95014954 +0000 UTC m=+33.325980581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:20.128154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:20.128099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:20.128154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:20.128122 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:20.128407 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:20.128227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:20.128407 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:20.128243 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:20.128407 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:20.128318 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:20.128566 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:20.128445 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:22.128369 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:22.128326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:22.128870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:22.128326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:22.128870 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:22.128463 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:22.128870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:22.128340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:22.128870 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:22.128556 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:22.128870 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:22.128662 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:24.128039 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:24.128003 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:24.128475 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:24.128046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:24.128475 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:24.128046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:24.128475 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:24.128129 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:24.128475 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:24.128232 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:24.128475 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:24.128327 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:26.128714 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.128552 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:26.129132 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.128592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:26.129132 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:26.128799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:26.129132 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.128594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:26.129132 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:26.128877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:26.129132 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:26.128934 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:26.238967 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.238934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vkj7n" event={"ID":"8f165785-2bea-4425-a941-20a9fe239172","Type":"ContainerStarted","Data":"c544cba78dfd1d1d2f8c8c8c1e0ff9c28919040718da0b7c42f05892ac30d021"} Jul 09 04:00:26.240369 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.240341 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-clxk6" event={"ID":"b73f5423-f909-48e8-bd78-e513dce89b29","Type":"ContainerStarted","Data":"18bf72537a0f184a78391c59bf99134f04248d27a00346174de23006ec13a6c0"} Jul 09 04:00:26.241637 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.241617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" event={"ID":"51acc6f74353a35d5f168e3015e79515","Type":"ContainerStarted","Data":"8a4de1675bb53c58425e090a27593e5953eb77e0969894990ddd36d492bf6580"} Jul 09 04:00:26.244014 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.243996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:00:26.244332 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.244308 2563 generic.go:356] "Generic (PLEG): container finished" podID="519c1872-7de3-4c69-abbb-83251c7fadb2" containerID="04f67c48cfb4e47e923c9f15c0de5ab53971e8081d2d5e53056a14441142fd6e" exitCode=1 Jul 09 04:00:26.244404 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.244350 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"a6a46fcf57dd14bb49d6ae77e6f7163ca6103286ea6af630946bbdb838db076d"} Jul 09 04:00:26.244446 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.244421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"40626cd764ff56082aefed8fa7075e5d3bd9c139d9e2a8846996b75d01601548"} Jul 09 04:00:26.244484 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.244471 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerDied","Data":"04f67c48cfb4e47e923c9f15c0de5ab53971e8081d2d5e53056a14441142fd6e"} Jul 09 04:00:26.244542 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.244527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"5fb5a015809c439ba4e3b8eb6fa20908491a243267f35ca4b45bff1c9ca50a3f"} Jul 09 04:00:26.256549 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.256499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vkj7n" podStartSLOduration=2.505830236 podStartE2EDuration="23.256486032s" totalImagesPullingTime="20.750655796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:26.255982266 +0000 UTC m=+23.631813328" watchObservedRunningTime="2026-07-09 04:00:26.256486032 +0000 UTC m=+23.632317095" Jul 09 04:00:26.269166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.269122 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-152.ec2.internal" podStartSLOduration=22.269107796 podStartE2EDuration="22.269107796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:26.268964944 +0000 UTC m=+23.644796007" watchObservedRunningTime="2026-07-09 04:00:26.269107796 +0000 UTC m=+23.644938859" Jul 09 04:00:26.287140 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:26.287099 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-clxk6" podStartSLOduration=2.4981102379999998 podStartE2EDuration="23.287083343s" totalImagesPullingTime="20.788973105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:26.286644151 +0000 UTC m=+23.662475214" watchObservedRunningTime="2026-07-09 04:00:26.287083343 +0000 UTC m=+23.662914480" Jul 09 04:00:27.250199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.250002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:00:27.250951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.250619 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"7f94bc75ea9719f27571b5b3bdde79b8e1809a28c2a81c737f1f61b5dc26ce9e"} Jul 09 04:00:27.250951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.250703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"db056b02c885a9d17cb6723e4456f0295cd33ec34902e5aa396283aa5430f42b"} Jul 09 04:00:27.252486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.252454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l9k9m" event={"ID":"89a730a1-1a58-43e0-9b37-ff864cc4143c","Type":"ContainerStarted","Data":"d3fec190794432518e107b83c9cc77ce12758b42c8d09b104dad98c645325be8"} Jul 09 04:00:27.254143 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.254113 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="f9434044d2f4cef75e457e090be74286c2577ba54b8e6ec598a2ce9e3d159c43" exitCode=0 Jul 09 04:00:27.254250 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.254164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"f9434044d2f4cef75e457e090be74286c2577ba54b8e6ec598a2ce9e3d159c43"} Jul 09 04:00:27.256600 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.256577 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" event={"ID":"c47103b7-74f0-4807-ba24-27be90ea4805","Type":"ContainerStarted","Data":"beba8fcfe594c8f1986e7ef53739851e806a1dc8c8a7f55e8798ccdcf7505730"} Jul 09 04:00:27.258426 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.258404 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2xs9c" event={"ID":"bb65c651-889f-43d7-bb05-1f9e0b7e41a6","Type":"ContainerStarted","Data":"9bba6a3b2a8f20aaaf8eb23f07f86fc3db1fc6f6dd299a6cebdc37e058707881"} Jul 09 04:00:27.260251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.260227 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cblsd" event={"ID":"16746381-a780-4428-be80-fa590d45f7ee","Type":"ContainerStarted","Data":"6489b3e45ae6b940ce8cd2925b76d0a27fcc0651607b173cb1c0f96a3710ac58"} Jul 09 04:00:27.262274 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.262252 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw67f" event={"ID":"1b8ede72-26f2-4e07-a7cc-646b9d0e3abf","Type":"ContainerStarted","Data":"44de259cbd3a2c03c0547d49a7bf6e70808b811d91c056d7c5471f8674b8fb60"} Jul 09 04:00:27.263721 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.263697 2563 generic.go:356] "Generic (PLEG): container finished" podID="ffc1167e7e8dc7b8789dca3288b9765d" containerID="6d095b0e3aa8e5a3867b8721757bf56d4babd5e830e218c85e3eacb85b599426" exitCode=0 Jul 09 04:00:27.263909 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.263840 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"ffc1167e7e8dc7b8789dca3288b9765d","Type":"ContainerDied","Data":"6d095b0e3aa8e5a3867b8721757bf56d4babd5e830e218c85e3eacb85b599426"} Jul 09 04:00:27.281885 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.281809 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l9k9m" podStartSLOduration=3.46361933 podStartE2EDuration="24.281788188s" totalImagesPullingTime="20.818168858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:27.26678635 +0000 UTC m=+24.642617414" watchObservedRunningTime="2026-07-09 04:00:27.281788188 +0000 UTC m=+24.657619242" Jul 09 04:00:27.282516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.282486 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2xs9c" podStartSLOduration=8.136505442 podStartE2EDuration="24.282475001s" totalImagesPullingTime="16.145969559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:27.281914307 +0000 UTC m=+24.657745371" watchObservedRunningTime="2026-07-09 04:00:27.282475001 +0000 UTC m=+24.658306065" Jul 09 04:00:27.326737 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.326674 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lw67f" podStartSLOduration=8.262605729 podStartE2EDuration="24.32665399s" totalImagesPullingTime="16.064048261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:27.326121073 +0000 UTC m=+24.701952136" watchObservedRunningTime="2026-07-09 04:00:27.32665399 +0000 UTC m=+24.702485056" Jul 09 04:00:27.340396 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.340341 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cblsd" podStartSLOduration=3.61565839 podStartE2EDuration="24.340321894s" totalImagesPullingTime="20.724663504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:27.340156383 +0000 UTC m=+24.715987447" watchObservedRunningTime="2026-07-09 04:00:27.340321894 +0000 UTC m=+24.716152958" Jul 09 04:00:27.852314 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:27.852278 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 04:00:28.091718 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.091629 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T04:00:27.852310532Z","UUID":"690076dd-9c31-4695-8d4a-d412caf1f6b7","Handler":null,"Name":"","Endpoint":""} Jul 09 04:00:28.093083 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.093064 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 04:00:28.093198 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.093100 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 04:00:28.128331 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.128302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:28.128493 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.128397 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:28.128493 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:28.128403 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:28.128493 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.128403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:28.128493 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:28.128481 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:28.128669 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:28.128566 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:28.267794 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.267751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" event={"ID":"ffc1167e7e8dc7b8789dca3288b9765d","Type":"ContainerStarted","Data":"9e4bdc964ad1693f3175bb8442a39bca911ffcc54afa7663126d15379c11ffc5"} Jul 09 04:00:28.269549 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.269518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" event={"ID":"c47103b7-74f0-4807-ba24-27be90ea4805","Type":"ContainerStarted","Data":"ac72e999dbbe39a3f2ffff0eab87ff7457bb526e5c7eba5f386e15180d9f33e1"} Jul 09 04:00:28.283102 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:28.283065 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-152.ec2.internal" podStartSLOduration=24.283053766 podStartE2EDuration="24.283053766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:28.282480431 +0000 UTC m=+25.658311494" watchObservedRunningTime="2026-07-09 04:00:28.283053766 +0000 UTC m=+25.658884829" Jul 09 04:00:29.276015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:29.275713 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:00:29.276538 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:29.276388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"40d89d469bd2e0b35d6da3f2cfd93ae7780142aa7e67daba308f1f5d2f4db6ee"} Jul 09 04:00:29.278683 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:29.278641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" event={"ID":"c47103b7-74f0-4807-ba24-27be90ea4805","Type":"ContainerStarted","Data":"60f409848f91cdc7d71370015c9734c215731497ece8618e806f1dd5877f35bf"} Jul 09 04:00:29.296819 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:29.296758 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgg4r" podStartSLOduration=3.379033055 podStartE2EDuration="26.296741867s" totalImagesPullingTime="22.917708812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:29.296599331 +0000 UTC m=+26.672430394" watchObservedRunningTime="2026-07-09 04:00:29.296741867 +0000 UTC m=+26.672572931" Jul 09 04:00:30.128020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:30.127980 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:30.128020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:30.128020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:30.128286 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:30.128020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:30.128286 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:30.128100 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:30.128286 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:30.128194 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:30.128286 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:30.128245 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:31.049888 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.049673 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:31.050746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.050354 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:31.286899 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.286864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:00:31.287307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.287275 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"a852ffd1ae33e81549d2ffc9b7d6b05fae8eebc2f5f6d85c89d8280b35776ffc"} Jul 09 04:00:31.287687 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.287658 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:31.287904 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.287880 2563 scope.go:117] "RemoveContainer" containerID="04f67c48cfb4e47e923c9f15c0de5ab53971e8081d2d5e53056a14441142fd6e" Jul 09 04:00:31.288808 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:31.288762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2xs9c" Jul 09 04:00:32.128496 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.128461 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:32.128927 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.128609 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:32.128927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.128645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:32.128927 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.128791 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:32.128927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.128874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:32.129096 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.128944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:32.610639 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.610606 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c5rl"] Jul 09 04:00:32.610801 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.610705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:32.610898 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.610798 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:32.612034 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.612003 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kvjw"] Jul 09 04:00:32.612146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.612109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:32.612220 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.612199 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:32.612666 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.612647 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rmwnt"] Jul 09 04:00:32.612756 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:32.612734 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:32.612854 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:32.612818 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:33.295107 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.295024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:00:33.295613 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.295420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" event={"ID":"519c1872-7de3-4c69-abbb-83251c7fadb2","Type":"ContainerStarted","Data":"7247db0c8f526f6fcc8a0ab590cc53fe02ea85f840bbc6af40ed4e5168507827"} Jul 09 04:00:33.295717 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.295680 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:33.295765 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.295737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:33.295812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.295783 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:33.297376 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.297349 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="759f90c7995828f536585f592420eb95386ac323d2f66f74dc7d63e6ec471d12" exitCode=0 Jul 09 04:00:33.297518 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.297420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"759f90c7995828f536585f592420eb95386ac323d2f66f74dc7d63e6ec471d12"} Jul 09 04:00:33.311994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.311972 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:33.312116 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.312079 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:00:33.322241 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:33.322200 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" podStartSLOduration=9.152586164 podStartE2EDuration="30.322186767s" totalImagesPullingTime="21.169600603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:33.321631536 +0000 UTC m=+30.697462611" watchObservedRunningTime="2026-07-09 04:00:33.322186767 +0000 UTC m=+30.698017871" Jul 09 04:00:34.128247 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:34.128212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:34.128400 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:34.128256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:34.128400 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:34.128258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:34.128400 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:34.128333 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:34.128499 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:34.128413 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:34.128499 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:34.128472 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:35.304637 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.304600 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="84fd5cbcb22404d277b04b50ac529ec727d180db80851361fc222749dd60b508" exitCode=0 Jul 09 04:00:35.305383 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.304682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"84fd5cbcb22404d277b04b50ac529ec727d180db80851361fc222749dd60b508"} Jul 09 04:00:35.318665 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.318629 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" podUID="519c1872-7de3-4c69-abbb-83251c7fadb2" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 04:00:35.424271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.424232 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:35.516185 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.516093 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:35.766357 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.766266 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:35.766532 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.766435 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:35.766532 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.766511 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs podName:7ec00541-a6a5-47e5-a1cc-14185bedfc23 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:07.76648998 +0000 UTC m=+65.142321035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs") pod "network-metrics-daemon-rmwnt" (UID: "7ec00541-a6a5-47e5-a1cc-14185bedfc23") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 04:00:35.866953 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.866916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:35.867096 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.867034 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:35.867096 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.867088 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret podName:64a11f65-1fb8-4a92-8f1c-a37df9602807 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:07.867073868 +0000 UTC m=+65.242904909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret") pod "global-pull-secret-syncer-9c5rl" (UID: "64a11f65-1fb8-4a92-8f1c-a37df9602807") : object "kube-system"/"original-pull-secret" not registered Jul 09 04:00:35.968036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:35.967997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:35.968196 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.968155 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 04:00:35.968196 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.968176 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 04:00:35.968196 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.968185 2563 projected.go:196] Error preparing data for projected volume kube-api-access-h5cfj for pod openshift-network-diagnostics/network-check-target-7kvjw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:35.968302 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:35.968235 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj podName:8e3fa132-c5fc-4440-8cae-e4e7eb241029 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:07.968221442 +0000 UTC m=+65.344052483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5cfj" (UniqueName: "kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj") pod "network-check-target-7kvjw" (UID: "8e3fa132-c5fc-4440-8cae-e4e7eb241029") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 04:00:36.128426 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.128378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:36.128426 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.128418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:36.128651 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.128420 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:36.128651 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:36.128531 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:36.128651 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:36.128615 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:36.128791 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:36.128656 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:36.634007 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.633951 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:36.738954 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.738925 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:36.834649 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:36.834615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:37.667916 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:37.667888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:37.719698 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:37.719615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:38.128053 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.128017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:38.128220 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.128083 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:38.128220 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.128171 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:38.128220 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.128186 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kvjw" podUID="8e3fa132-c5fc-4440-8cae-e4e7eb241029" Jul 09 04:00:38.128398 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.128292 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rmwnt" podUID="7ec00541-a6a5-47e5-a1cc-14185bedfc23" Jul 09 04:00:38.128398 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.128383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5rl" podUID="64a11f65-1fb8-4a92-8f1c-a37df9602807" Jul 09 04:00:38.314671 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.314641 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="178e0acdcf8c2b4a82722625d4e67d04f48f86360f8c9a91eefe097dc9a579f0" exitCode=0 Jul 09 04:00:38.314671 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.314683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"178e0acdcf8c2b4a82722625d4e67d04f48f86360f8c9a91eefe097dc9a579f0"} Jul 09 04:00:38.382871 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.382783 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-152.ec2.internal" event="NodeReady" Jul 09 04:00:38.383004 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.382939 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 04:00:38.402887 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.402855 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:38.416856 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.416814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d55978ffd-nkg54"] Jul 09 04:00:38.418764 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.418738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.421405 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.421381 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8j4f\"" Jul 09 04:00:38.421405 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.421380 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 04:00:38.421529 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.421467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 04:00:38.421574 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.421555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 04:00:38.426678 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.426655 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 04:00:38.427575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.427558 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5gxkz"] Jul 09 04:00:38.429167 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.429153 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.431815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.431792 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 04:00:38.431929 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.431847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 04:00:38.432140 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.432128 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b4nw\"" Jul 09 04:00:38.433327 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.433307 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-brv8l"] Jul 09 04:00:38.435122 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.435101 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d55978ffd-nkg54"] Jul 09 04:00:38.435224 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.435210 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.437736 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.437717 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pc8bq\"" Jul 09 04:00:38.437855 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.437773 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 04:00:38.438069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.438053 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 04:00:38.438171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.438140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 04:00:38.440754 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.440733 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gxkz"] Jul 09 04:00:38.449306 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.449288 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brv8l"] Jul 09 04:00:38.484374 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484374 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jncfp\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.484559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.484560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.504786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.504749 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:38.571434 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.571398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:38.585521 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.585521 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585523 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-tmp-dir\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.585705 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.585705 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jncfp\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.585705 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.585705 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v8kg\" (UniqueName: \"kubernetes.io/projected/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-kube-api-access-6v8kg\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.585879 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.585804 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:38.585879 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585813 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-config-volume\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.585879 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.585848 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:38.585983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.585983 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.585919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:39.085897066 +0000 UTC m=+36.461728109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:38.585983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.586094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.585987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.586094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.586094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8180b1f-8fde-420b-97ef-a6b945ad821b-cert\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.586204 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rjq\" (UniqueName: \"kubernetes.io/projected/c8180b1f-8fde-420b-97ef-a6b945ad821b-kube-api-access-49rjq\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.586204 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.586289 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.586346 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.587000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.586968 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.589842 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.589695 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.589922 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.589715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.594887 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.594861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.595040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.595023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jncfp\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:38.687157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687045 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v8kg\" (UniqueName: \"kubernetes.io/projected/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-kube-api-access-6v8kg\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.687157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-config-volume\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.687157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8180b1f-8fde-420b-97ef-a6b945ad821b-cert\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rjq\" (UniqueName: \"kubernetes.io/projected/c8180b1f-8fde-420b-97ef-a6b945ad821b-kube-api-access-49rjq\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.687275 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-tmp-dir\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:38.687353 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:00:39.187332185 +0000 UTC m=+36.563163244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-config-volume\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.687860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.687742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-tmp-dir\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.689937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.689910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8180b1f-8fde-420b-97ef-a6b945ad821b-cert\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.695556 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.695533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v8kg\" (UniqueName: \"kubernetes.io/projected/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-kube-api-access-6v8kg\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:38.695873 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.695854 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rjq\" (UniqueName: \"kubernetes.io/projected/c8180b1f-8fde-420b-97ef-a6b945ad821b-kube-api-access-49rjq\") pod \"ingress-canary-brv8l\" (UID: \"c8180b1f-8fde-420b-97ef-a6b945ad821b\") " pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.744459 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.744434 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-brv8l" Jul 09 04:00:38.880017 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:38.879987 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-brv8l"] Jul 09 04:00:38.883524 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:38.883492 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8180b1f_8fde_420b_97ef_a6b945ad821b.slice/crio-c9140dfd4256ba51ad7cfe0635bfac30a8e7f7fa521385524fef6b842e0937b6 WatchSource:0}: Error finding container c9140dfd4256ba51ad7cfe0635bfac30a8e7f7fa521385524fef6b842e0937b6: Status 404 returned error can't find the container with id c9140dfd4256ba51ad7cfe0635bfac30a8e7f7fa521385524fef6b842e0937b6 Jul 09 04:00:39.090251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:39.090215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:39.090431 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:39.090366 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:39.090431 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:39.090384 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:39.090518 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:39.090435 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:40.090420313 +0000 UTC m=+37.466251354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:39.191610 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:39.191568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:39.191783 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:39.191722 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:39.191783 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:39.191782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:00:40.191766743 +0000 UTC m=+37.567597784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:39.318624 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:39.318580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brv8l" event={"ID":"c8180b1f-8fde-420b-97ef-a6b945ad821b","Type":"ContainerStarted","Data":"c9140dfd4256ba51ad7cfe0635bfac30a8e7f7fa521385524fef6b842e0937b6"} Jul 09 04:00:39.569558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:39.569516 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:39.626159 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:39.626107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:40.099047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.099006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:40.099420 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:40.099198 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:40.099420 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:40.099223 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:40.099420 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:40.099292 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:42.099272459 +0000 UTC m=+39.475103505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:40.128076 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.128042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:00:40.128259 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.128082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:00:40.128259 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.128092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:00:40.132261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132237 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 04:00:40.132454 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:00:40.132454 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqsq9\"" Jul 09 04:00:40.132569 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132463 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbqhw\"" Jul 09 04:00:40.132569 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132407 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 04:00:40.132569 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.132463 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:00:40.199771 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:40.199739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:40.199979 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:40.199919 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:40.200043 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:40.199991 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:00:42.199972478 +0000 UTC m=+39.575803519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:41.324817 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:41.324787 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-brv8l" event={"ID":"c8180b1f-8fde-420b-97ef-a6b945ad821b","Type":"ContainerStarted","Data":"188bb1d0f6ee35009263447209d2af8c71f231afe6730e4b515f008b294e851d"} Jul 09 04:00:41.341808 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:41.341749 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-brv8l" podStartSLOduration=1.253989522 podStartE2EDuration="3.341726019s" totalImagesPullingTime="2.087736497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:41.340318371 +0000 UTC m=+38.716149438" watchObservedRunningTime="2026-07-09 04:00:41.341726019 +0000 UTC m=+38.717557087" Jul 09 04:00:42.117076 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:42.116897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:42.117076 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:42.117069 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:42.117322 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:42.117093 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:42.117322 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:42.117161 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:46.117139655 +0000 UTC m=+43.492970697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:42.218266 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:42.218233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:42.218451 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:42.218352 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:42.218451 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:42.218410 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:00:46.218395776 +0000 UTC m=+43.594226817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:42.823417 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:42.823383 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:42.929261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:42.929189 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:45.336726 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:45.336688 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="1bc9f8a8e6488aec7839baab98795742ae2f3e2a9bdb5014dc6809755ec9c2be" exitCode=0 Jul 09 04:00:45.337173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:45.336744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"1bc9f8a8e6488aec7839baab98795742ae2f3e2a9bdb5014dc6809755ec9c2be"} Jul 09 04:00:46.148427 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.148388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:46.148576 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:46.148548 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:46.148576 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:46.148570 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:46.148648 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:46.148623 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:54.148608624 +0000 UTC m=+51.524439665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:46.248802 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.248766 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:46.249022 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:46.248889 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:46.249022 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:46.248940 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:00:54.24892675 +0000 UTC m=+51.624757791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:46.249108 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.249020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:46.341870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.341808 2563 generic.go:356] "Generic (PLEG): container finished" podID="618acde9-2f54-45b6-9c8a-b93383698ef2" containerID="96bc0833d27d32cfc09020d730e580466aa017f1cb4ee4b1294273e1f544b4b5" exitCode=0 Jul 09 04:00:46.341870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.341859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerDied","Data":"96bc0833d27d32cfc09020d730e580466aa017f1cb4ee4b1294273e1f544b4b5"} Jul 09 04:00:46.749271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.749191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:46.854199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:46.854169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.210217 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.210158 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.308347 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.308309 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.347248 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.347210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" event={"ID":"618acde9-2f54-45b6-9c8a-b93383698ef2","Type":"ContainerStarted","Data":"9f2709762e161243cf1d8b87cc0a7338d16dc7c8c76315384a6349bce9f02f30"} Jul 09 04:00:47.371132 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.371077 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hxd6f" podStartSLOduration=8.742119799 podStartE2EDuration="44.371062677s" totalImagesPullingTime="35.628942878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:47.369570023 +0000 UTC m=+44.745401086" watchObservedRunningTime="2026-07-09 04:00:47.371062677 +0000 UTC m=+44.746893740" Jul 09 04:00:47.409745 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.409711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.509068 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.508989 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.608651 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.608618 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:47.674787 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:47.674756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:48.210228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.210192 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4"] Jul 09 04:00:48.231265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.231237 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4"] Jul 09 04:00:48.231424 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.231351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" Jul 09 04:00:48.234085 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.234063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 04:00:48.234085 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.234088 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kqxxd\"" Jul 09 04:00:48.234304 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.234063 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 04:00:48.249291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.249265 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:48.364442 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.364407 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5sr4\" (UniqueName: \"kubernetes.io/projected/297ab8c1-40c7-43bb-a434-6168aa52947c-kube-api-access-n5sr4\") pod \"migrator-d57d58cc9-4ppb4\" (UID: \"297ab8c1-40c7-43bb-a434-6168aa52947c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" Jul 09 04:00:48.465384 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.465309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5sr4\" (UniqueName: \"kubernetes.io/projected/297ab8c1-40c7-43bb-a434-6168aa52947c-kube-api-access-n5sr4\") pod \"migrator-d57d58cc9-4ppb4\" (UID: \"297ab8c1-40c7-43bb-a434-6168aa52947c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" Jul 09 04:00:48.474940 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.474910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5sr4\" (UniqueName: \"kubernetes.io/projected/297ab8c1-40c7-43bb-a434-6168aa52947c-kube-api-access-n5sr4\") pod \"migrator-d57d58cc9-4ppb4\" (UID: \"297ab8c1-40c7-43bb-a434-6168aa52947c\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" Jul 09 04:00:48.485411 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.485382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:48.537943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.537911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:48.539866 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.539850 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" Jul 09 04:00:48.635527 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.635490 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-llq2j"] Jul 09 04:00:48.651977 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.651934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:48.659112 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.659085 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llq2j"] Jul 09 04:00:48.659308 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.659200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.661949 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.661902 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 04:00:48.662094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.661977 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 04:00:48.662094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.661978 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 04:00:48.662094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.662093 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 04:00:48.662265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.662097 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwpz9\"" Jul 09 04:00:48.689487 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.689451 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4"] Jul 09 04:00:48.692418 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:00:48.692394 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297ab8c1_40c7_43bb_a434_6168aa52947c.slice/crio-4c602ba1dda1f057486453cf1028eef640d5562a376df43c3c74ee5eb908d33a WatchSource:0}: Error finding container 4c602ba1dda1f057486453cf1028eef640d5562a376df43c3c74ee5eb908d33a: Status 404 returned error can't find the container with id 4c602ba1dda1f057486453cf1028eef640d5562a376df43c3c74ee5eb908d33a Jul 09 04:00:48.769153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.769077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.769153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.769114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68222cc3-7c8a-43e9-a957-6191c3f36d25-data-volume\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.769153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.769133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtf8g\" (UniqueName: \"kubernetes.io/projected/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-api-access-rtf8g\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.769349 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.769170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68222cc3-7c8a-43e9-a957-6191c3f36d25-crio-socket\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.769349 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.769235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.869866 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.869805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.869866 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.869867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68222cc3-7c8a-43e9-a957-6191c3f36d25-data-volume\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870065 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:48.869962 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:00:48.870065 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:48.870022 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:49.370006001 +0000 UTC m=+46.745837043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : secret "insights-runtime-extractor-tls" not found Jul 09 04:00:48.870065 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.870039 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtf8g\" (UniqueName: \"kubernetes.io/projected/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-api-access-rtf8g\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.870083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68222cc3-7c8a-43e9-a957-6191c3f36d25-crio-socket\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.870118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.870125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68222cc3-7c8a-43e9-a957-6191c3f36d25-data-volume\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870228 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:48.870212 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:00:48.870369 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.870256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68222cc3-7c8a-43e9-a957-6191c3f36d25-crio-socket\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:48.870369 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:48.870267 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:49.370252615 +0000 UTC m=+46.746083657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : configmap "kube-rbac-proxy" not found Jul 09 04:00:48.878771 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:48.878744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtf8g\" (UniqueName: \"kubernetes.io/projected/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-api-access-rtf8g\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:49.352535 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.352493 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" event={"ID":"297ab8c1-40c7-43bb-a434-6168aa52947c","Type":"ContainerStarted","Data":"4c602ba1dda1f057486453cf1028eef640d5562a376df43c3c74ee5eb908d33a"} Jul 09 04:00:49.373983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.373955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:49.374320 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.374010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:49.374320 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:49.374084 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:00:49.374320 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:49.374095 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:00:49.374320 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:49.374146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:50.37413079 +0000 UTC m=+47.749961833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : configmap "kube-rbac-proxy" not found Jul 09 04:00:49.374320 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:49.374160 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:50.374154074 +0000 UTC m=+47.749985115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : secret "insights-runtime-extractor-tls" not found Jul 09 04:00:49.836349 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.836309 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:49.904467 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.904428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:49.977741 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:49.977677 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:50.383856 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:50.383810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:50.384269 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:50.383931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:50.384269 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:50.383937 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 04:00:50.384269 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:50.384000 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:52.383982278 +0000 UTC m=+49.759813319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : configmap "kube-rbac-proxy" not found Jul 09 04:00:50.384269 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:50.384049 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:00:50.384269 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:50.384097 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:52.384086352 +0000 UTC m=+49.759917393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : secret "insights-runtime-extractor-tls" not found Jul 09 04:00:51.004231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.004152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw67f_1b8ede72-26f2-4e07-a7cc-646b9d0e3abf/dns-node-resolver/0.log" Jul 09 04:00:51.358752 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.358711 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" event={"ID":"297ab8c1-40c7-43bb-a434-6168aa52947c","Type":"ContainerStarted","Data":"6727cdcca6f7da6cecbe7eb2589e2bd2b5518d6b8a1447c02780d36aa956776a"} Jul 09 04:00:51.358938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.358762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" event={"ID":"297ab8c1-40c7-43bb-a434-6168aa52947c","Type":"ContainerStarted","Data":"d190aa0d6a6edb1888122209703b351b58840b5047d52d4d7cd56f7404b23f2e"} Jul 09 04:00:51.377011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.376959 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4ppb4" podStartSLOduration=1.487630006 podStartE2EDuration="3.376943727s" totalImagesPullingTime="1.889313721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:51.375268485 +0000 UTC m=+48.751099549" watchObservedRunningTime="2026-07-09 04:00:51.376943727 +0000 UTC m=+48.752774808" Jul 09 04:00:51.659116 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.659000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:51.804229 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:51.804202 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cblsd_16746381-a780-4428-be80-fa590d45f7ee/node-ca/0.log" Jul 09 04:00:52.398655 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:52.398608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:52.398870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:52.398721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:52.398934 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:52.398884 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:00:52.398968 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:52.398948 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:00:56.398932943 +0000 UTC m=+53.774763985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : secret "insights-runtime-extractor-tls" not found Jul 09 04:00:52.399142 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:52.399124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68222cc3-7c8a-43e9-a957-6191c3f36d25-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:52.401507 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:52.401482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:52.808766 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:52.808728 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brv8l_c8180b1f-8fde-420b-97ef-a6b945ad821b/serve-healthcheck-canary/0.log" Jul 09 04:00:53.204738 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:53.204662 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4ppb4_297ab8c1-40c7-43bb-a434-6168aa52947c/migrator/0.log" Jul 09 04:00:53.404294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:53.404267 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4ppb4_297ab8c1-40c7-43bb-a434-6168aa52947c/graceful-termination/0.log" Jul 09 04:00:53.533146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:53.533111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:53.633592 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:53.633565 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:54.216638 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:54.216594 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:00:54.217041 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:54.216760 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 04:00:54.217041 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:54.216784 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d55978ffd-nkg54: secret "image-registry-tls" not found Jul 09 04:00:54.217041 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:54.216870 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls podName:431fefd6-49c8-4836-83d3-3b94d5461557 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:10.216852907 +0000 UTC m=+67.592683961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls") pod "image-registry-6d55978ffd-nkg54" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557") : secret "image-registry-tls" not found Jul 09 04:00:54.317616 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:54.317576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:00:54.317819 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:54.317730 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 04:00:54.317819 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:54.317799 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls podName:1d0a65f8-dc27-44f3-813e-35f8feb07e0a nodeName:}" failed. No retries permitted until 2026-07-09 04:01:10.31778301 +0000 UTC m=+67.693614051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls") pod "dns-default-5gxkz" (UID: "1d0a65f8-dc27-44f3-813e-35f8feb07e0a") : secret "dns-default-metrics-tls" not found Jul 09 04:00:55.648108 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:55.648073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:55.750984 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:55.750949 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:56.429413 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:56.429370 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:56.433874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:56.433811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:00:56.434004 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:56.433950 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 04:00:56.434045 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:00:56.434005 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls podName:68222cc3-7c8a-43e9-a957-6191c3f36d25 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:04.433991518 +0000 UTC m=+61.809822558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls") pod "insights-runtime-extractor-llq2j" (UID: "68222cc3-7c8a-43e9-a957-6191c3f36d25") : secret "insights-runtime-extractor-tls" not found Jul 09 04:00:56.826371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:56.826324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:57.013409 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:57.013375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:58.539961 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:58.539927 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:58.641815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:58.641776 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:58.742557 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:58.742530 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:58.843088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:58.842994 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:59.220353 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:59.220261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:59.430034 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:59.430004 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:00:59.490286 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:00:59.490197 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:01.241073 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:01.241039 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:01.341095 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:01.341067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:02.278236 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:02.278208 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:02.624935 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:02.624903 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:02.823922 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:02.823890 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:03.018953 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:03.018875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:03.422712 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:03.422683 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:03.824662 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:03.824628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:04.313564 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.313535 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:04.494019 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.493976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:01:04.496368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.496334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68222cc3-7c8a-43e9-a957-6191c3f36d25-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-llq2j\" (UID: \"68222cc3-7c8a-43e9-a957-6191c3f36d25\") " pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:01:04.571765 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.571687 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwpz9\"" Jul 09 04:01:04.579972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.579946 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-llq2j" Jul 09 04:01:04.719497 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:04.719472 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-llq2j"] Jul 09 04:01:04.722202 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:04.722170 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68222cc3_7c8a_43e9_a957_6191c3f36d25.slice/crio-6148bb0e38d21d328cb1296e4d0157af5d158d1bc58c9aee562e0c8a1103cfaa WatchSource:0}: Error finding container 6148bb0e38d21d328cb1296e4d0157af5d158d1bc58c9aee562e0c8a1103cfaa: Status 404 returned error can't find the container with id 6148bb0e38d21d328cb1296e4d0157af5d158d1bc58c9aee562e0c8a1103cfaa Jul 09 04:01:05.314523 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:05.314497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dbv6k" Jul 09 04:01:05.393071 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:05.393037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llq2j" event={"ID":"68222cc3-7c8a-43e9-a957-6191c3f36d25","Type":"ContainerStarted","Data":"6148bb0e38d21d328cb1296e4d0157af5d158d1bc58c9aee562e0c8a1103cfaa"} Jul 09 04:01:06.023836 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:06.023802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:06.072283 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:06.072242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:07.823181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.823143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:01:07.826275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.826250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 04:01:07.835888 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.835864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ec00541-a6a5-47e5-a1cc-14185bedfc23-metrics-certs\") pod \"network-metrics-daemon-rmwnt\" (UID: \"7ec00541-a6a5-47e5-a1cc-14185bedfc23\") " pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:01:07.924741 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.924700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:01:07.927724 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.927699 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 04:01:07.938742 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:07.938713 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64a11f65-1fb8-4a92-8f1c-a37df9602807-original-pull-secret\") pod \"global-pull-secret-syncer-9c5rl\" (UID: \"64a11f65-1fb8-4a92-8f1c-a37df9602807\") " pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:01:08.025557 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.025518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:01:08.028695 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.028673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 04:01:08.038807 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.038782 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 04:01:08.042078 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.042058 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qqsq9\"" Jul 09 04:01:08.048602 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.048578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5cfj\" (UniqueName: \"kubernetes.io/projected/8e3fa132-c5fc-4440-8cae-e4e7eb241029-kube-api-access-h5cfj\") pod \"network-check-target-7kvjw\" (UID: \"8e3fa132-c5fc-4440-8cae-e4e7eb241029\") " pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:01:08.050357 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.050330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rmwnt" Jul 09 04:01:08.051544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.051522 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5rl" Jul 09 04:01:08.349085 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.349058 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vbqhw\"" Jul 09 04:01:08.356432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:08.356409 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:01:09.277650 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.277614 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rmwnt"] Jul 09 04:01:09.281722 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:09.281696 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec00541_a6a5_47e5_a1cc_14185bedfc23.slice/crio-a3f772e9c9fe485f7440137902a9cd066bbb5d771b865e54630d33394267403b WatchSource:0}: Error finding container a3f772e9c9fe485f7440137902a9cd066bbb5d771b865e54630d33394267403b: Status 404 returned error can't find the container with id a3f772e9c9fe485f7440137902a9cd066bbb5d771b865e54630d33394267403b Jul 09 04:01:09.310142 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.310112 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kvjw"] Jul 09 04:01:09.313191 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:09.313164 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3fa132_c5fc_4440_8cae_e4e7eb241029.slice/crio-7f26f26e0ce117500a12584703e2c3efd5fbf949f1eb7a3a924a5c6f3e752124 WatchSource:0}: Error finding container 7f26f26e0ce117500a12584703e2c3efd5fbf949f1eb7a3a924a5c6f3e752124: Status 404 returned error can't find the container with id 7f26f26e0ce117500a12584703e2c3efd5fbf949f1eb7a3a924a5c6f3e752124 Jul 09 04:01:09.404424 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.404337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kvjw" event={"ID":"8e3fa132-c5fc-4440-8cae-e4e7eb241029","Type":"ContainerStarted","Data":"7f26f26e0ce117500a12584703e2c3efd5fbf949f1eb7a3a924a5c6f3e752124"} Jul 09 04:01:09.405746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.405722 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llq2j" event={"ID":"68222cc3-7c8a-43e9-a957-6191c3f36d25","Type":"ContainerStarted","Data":"5351a5846d759d5e9fa2fa5a80ae1919501dfa95e7f521d1e7bc1d4ded5b9934"} Jul 09 04:01:09.406845 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.406807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rmwnt" event={"ID":"7ec00541-a6a5-47e5-a1cc-14185bedfc23","Type":"ContainerStarted","Data":"a3f772e9c9fe485f7440137902a9cd066bbb5d771b865e54630d33394267403b"} Jul 09 04:01:09.486094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.486055 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c5rl"] Jul 09 04:01:09.489871 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:09.489847 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a11f65_1fb8_4a92_8f1c_a37df9602807.slice/crio-5e392d062eec35b15cde6d4c58845b8e97203be8d3c3776adafbea596f6046cc WatchSource:0}: Error finding container 5e392d062eec35b15cde6d4c58845b8e97203be8d3c3776adafbea596f6046cc: Status 404 returned error can't find the container with id 5e392d062eec35b15cde6d4c58845b8e97203be8d3c3776adafbea596f6046cc Jul 09 04:01:09.588376 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.588340 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:09.688795 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:09.688689 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:10.200743 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.200719 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth"] Jul 09 04:01:10.203013 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.202990 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.206665 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.206639 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 04:01:10.207186 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.207027 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 04:01:10.207702 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.207498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 04:01:10.208417 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.208246 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 04:01:10.208417 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.208281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 04:01:10.208417 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.208299 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 04:01:10.209235 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.208982 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 04:01:10.220550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.220516 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth"] Jul 09 04:01:10.242409 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:01:10.242558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.242558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.242558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dw6d\" (UniqueName: \"kubernetes.io/projected/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-kube-api-access-9dw6d\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.242558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.242788 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.242788 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.242620 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.243977 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.243706 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d55978ffd-nkg54"] Jul 09 04:01:10.243977 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:01:10.243940 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" podUID="431fefd6-49c8-4836-83d3-3b94d5461557" Jul 09 04:01:10.245899 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.245873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"image-registry-6d55978ffd-nkg54\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:01:10.310529 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.310473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dw6d\" (UniqueName: \"kubernetes.io/projected/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-kube-api-access-9dw6d\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.344389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.343643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.347093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.345807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.349755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.349586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d0a65f8-dc27-44f3-813e-35f8feb07e0a-metrics-tls\") pod \"dns-default-5gxkz\" (UID: \"1d0a65f8-dc27-44f3-813e-35f8feb07e0a\") " pod="openshift-dns/dns-default-5gxkz" Jul 09 04:01:10.349755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.349711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.350370 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.350320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-ca\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.351975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.351935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.353033 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.352994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.357442 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.357395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dw6d\" (UniqueName: \"kubernetes.io/projected/4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd-kube-api-access-9dw6d\") pod \"cluster-proxy-proxy-agent-85b6d547c-gwfth\" (UID: \"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.415052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.414962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c5rl" event={"ID":"64a11f65-1fb8-4a92-8f1c-a37df9602807","Type":"ContainerStarted","Data":"5e392d062eec35b15cde6d4c58845b8e97203be8d3c3776adafbea596f6046cc"} Jul 09 04:01:10.418878 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.418848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llq2j" event={"ID":"68222cc3-7c8a-43e9-a957-6191c3f36d25","Type":"ContainerStarted","Data":"44ca27d273a82b9824be09e1a9c272542196fa2404b2c8b2a9f953c228f4e322"} Jul 09 04:01:10.421388 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.421351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:01:10.421888 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.421854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rmwnt" event={"ID":"7ec00541-a6a5-47e5-a1cc-14185bedfc23","Type":"ContainerStarted","Data":"162e3594a49f6e89ed13460ddf298db595dba3e34a2cd1d7cbb00d143ab554aa"} Jul 09 04:01:10.429953 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.429926 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:01:10.448877 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.448761 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rmwnt" podStartSLOduration=66.540478971 podStartE2EDuration="1m7.448740304s" totalImagesPullingTime="908.261333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:10.446640076 +0000 UTC m=+67.822471143" watchObservedRunningTime="2026-07-09 04:01:10.448740304 +0000 UTC m=+67.824571366" Jul 09 04:01:10.456188 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.456116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:10.530100 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.530017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:10.533563 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.533539 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" Jul 09 04:01:10.541309 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.541281 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b4nw\"" Jul 09 04:01:10.545989 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.545966 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jncfp\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546005 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546056 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546117 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546148 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546277 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546175 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546277 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546204 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca\") pod \"431fefd6-49c8-4836-83d3-3b94d5461557\" (UID: \"431fefd6-49c8-4836-83d3-3b94d5461557\") " Jul 09 04:01:10.546857 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546782 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:01:10.546979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.546886 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:01:10.547469 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.547362 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:01:10.549041 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.548817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gxkz" Jul 09 04:01:10.549355 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.549303 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:01:10.549983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.549943 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 04:01:10.550352 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.550323 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:01:10.550571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.550516 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:01:10.551053 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.551026 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp" (OuterVolumeSpecName: "kube-api-access-jncfp") pod "431fefd6-49c8-4836-83d3-3b94d5461557" (UID: "431fefd6-49c8-4836-83d3-3b94d5461557"). InnerVolumeSpecName "kube-api-access-jncfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:01:10.626764 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.626674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648866 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-bound-sa-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648901 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-installation-pull-secrets\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648918 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/431fefd6-49c8-4836-83d3-3b94d5461557-ca-trust-extracted\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648933 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-registry-certificates\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648954 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/431fefd6-49c8-4836-83d3-3b94d5461557-image-registry-private-configuration\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648969 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/431fefd6-49c8-4836-83d3-3b94d5461557-trusted-ca\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648983 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jncfp\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-kube-api-access-jncfp\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.649036 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.648998 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/431fefd6-49c8-4836-83d3-3b94d5461557-registry-tls\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:01:10.697999 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.697861 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth"] Jul 09 04:01:10.702229 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:10.701962 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d6e783b_bf03_49dc_8c3f_fe1e2a7130fd.slice/crio-98f8ba7695c0ffa31162ecd7ef69e54b5bc6036683c8073047965d6e51bf35f0 WatchSource:0}: Error finding container 98f8ba7695c0ffa31162ecd7ef69e54b5bc6036683c8073047965d6e51bf35f0: Status 404 returned error can't find the container with id 98f8ba7695c0ffa31162ecd7ef69e54b5bc6036683c8073047965d6e51bf35f0 Jul 09 04:01:10.729197 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:10.729097 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gxkz"] Jul 09 04:01:10.735258 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:10.735222 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0a65f8_dc27_44f3_813e_35f8feb07e0a.slice/crio-0d66f56495152db1ccb6645b10aba843dd7019e143bb6fb0c563193dc75849b9 WatchSource:0}: Error finding container 0d66f56495152db1ccb6645b10aba843dd7019e143bb6fb0c563193dc75849b9: Status 404 returned error can't find the container with id 0d66f56495152db1ccb6645b10aba843dd7019e143bb6fb0c563193dc75849b9 Jul 09 04:01:11.279075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.278999 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:11.429014 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.428743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gxkz" event={"ID":"1d0a65f8-dc27-44f3-813e-35f8feb07e0a","Type":"ContainerStarted","Data":"0d66f56495152db1ccb6645b10aba843dd7019e143bb6fb0c563193dc75849b9"} Jul 09 04:01:11.430680 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.430653 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" event={"ID":"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd","Type":"ContainerStarted","Data":"98f8ba7695c0ffa31162ecd7ef69e54b5bc6036683c8073047965d6e51bf35f0"} Jul 09 04:01:11.434745 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.433244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d55978ffd-nkg54" Jul 09 04:01:11.434745 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.434309 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rmwnt" event={"ID":"7ec00541-a6a5-47e5-a1cc-14185bedfc23","Type":"ContainerStarted","Data":"1cc4083c84b80c750533cf1d534e4f8b9ba8402902436ec8c4acfeea998f95f1"} Jul 09 04:01:11.469547 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.469446 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d55978ffd-nkg54"] Jul 09 04:01:11.474004 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.473942 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d55978ffd-nkg54"] Jul 09 04:01:11.670600 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.670564 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:11.771280 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:11.771156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:13.133394 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:13.133358 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431fefd6-49c8-4836-83d3-3b94d5461557" path="/var/lib/kubelet/pods/431fefd6-49c8-4836-83d3-3b94d5461557/volumes" Jul 09 04:01:14.712443 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:14.712406 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:14.813285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:14.813249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:14.866014 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:14.865980 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.444440 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.444387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.546253 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.546193 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.624542 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.624509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.732439 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.732344 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.832723 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.832681 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:16.934372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:16.934329 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.034405 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.034357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.210416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.210379 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.397387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.397296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.447327 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.447276 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.592294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.592252 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:17.645924 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:17.645862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:18.905234 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:18.905200 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:18.954816 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:18.954787 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:19.033677 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.033650 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:19.137383 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.137299 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:19.466381 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.466300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kvjw" event={"ID":"8e3fa132-c5fc-4440-8cae-e4e7eb241029","Type":"ContainerStarted","Data":"e7cbb32ed658505b1f1ec85a906f55a659d42277ef80fe97925a71f4c9dd7ec7"} Jul 09 04:01:19.466525 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.466404 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:01:19.468206 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.468186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gxkz" event={"ID":"1d0a65f8-dc27-44f3-813e-35f8feb07e0a","Type":"ContainerStarted","Data":"76411c5e3a6b438cd5380e77710ba617c1bd310974b75919226f2f991ae0e14e"} Jul 09 04:01:19.468747 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.468723 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5gxkz" Jul 09 04:01:19.469019 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.468989 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gxkz" event={"ID":"1d0a65f8-dc27-44f3-813e-35f8feb07e0a","Type":"ContainerStarted","Data":"4bf0e3d2d01a009d7953e20b3af922c970a1605476233ae7fe814ca7257991ad"} Jul 09 04:01:19.473885 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.473852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" event={"ID":"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd","Type":"ContainerStarted","Data":"93cef5d27f5440bb9cda41839493ddc51978d473a7a9ad0b613ce84fd17b1a07"} Jul 09 04:01:19.473972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.473891 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" event={"ID":"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd","Type":"ContainerStarted","Data":"bb23faf9286940099db3c7a7bea9c2ab229e2ac2fc1a0cf8d24929a2c59d8f44"} Jul 09 04:01:19.473972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.473911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" event={"ID":"4d6e783b-bf03-49dc-8c3f-fe1e2a7130fd","Type":"ContainerStarted","Data":"4d75562151144abf05bf3ef216968fd097e4bb1294c24321fefdf073c8991650"} Jul 09 04:01:19.475663 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.475639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-llq2j" event={"ID":"68222cc3-7c8a-43e9-a957-6191c3f36d25","Type":"ContainerStarted","Data":"5bf4305de6111c630aa33b8f0a2eaefb35ed31a62489fa7786621fceaa5c37f5"} Jul 09 04:01:19.476897 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.476877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c5rl" event={"ID":"64a11f65-1fb8-4a92-8f1c-a37df9602807","Type":"ContainerStarted","Data":"cf2bcac6b38a4a0176cf6ad270a918999f9372412f26fd45ae3e0066f9aa9c7a"} Jul 09 04:01:19.482749 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.482709 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7kvjw" podStartSLOduration=67.195372636 podStartE2EDuration="1m16.482696725s" totalImagesPullingTime="9.287324089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:19.481776814 +0000 UTC m=+76.857607877" watchObservedRunningTime="2026-07-09 04:01:19.482696725 +0000 UTC m=+76.858527785" Jul 09 04:01:19.495964 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.495919 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9c5rl" podStartSLOduration=67.353250788 podStartE2EDuration="1m16.495902325s" totalImagesPullingTime="9.142651537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:19.49577088 +0000 UTC m=+76.871601945" watchObservedRunningTime="2026-07-09 04:01:19.495902325 +0000 UTC m=+76.871733388" Jul 09 04:01:19.513111 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.513065 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85b6d547c-gwfth" podStartSLOduration=1.568138345 podStartE2EDuration="9.513052018s" totalImagesPullingTime="7.944913673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:19.513021555 +0000 UTC m=+76.888852630" watchObservedRunningTime="2026-07-09 04:01:19.513052018 +0000 UTC m=+76.888883078" Jul 09 04:01:19.530545 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.530500 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5gxkz" podStartSLOduration=33.66600844 podStartE2EDuration="41.530483446s" totalImagesPullingTime="7.864475006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:19.530330095 +0000 UTC m=+76.906161160" watchObservedRunningTime="2026-07-09 04:01:19.530483446 +0000 UTC m=+76.906314510" Jul 09 04:01:19.549449 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:19.549395 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-llq2j" podStartSLOduration=17.801347314 podStartE2EDuration="31.549377797s" totalImagesPullingTime="13.748030483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:00:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:19.549123613 +0000 UTC m=+76.924954676" watchObservedRunningTime="2026-07-09 04:01:19.549377797 +0000 UTC m=+76.925208861" Jul 09 04:01:21.632410 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:21.632373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:21.709788 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:21.709750 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:21.876659 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:21.876624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:21.992812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:21.992721 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:22.083765 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:22.083735 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:22.945731 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:22.945698 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:23.010588 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:23.010539 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:24.589946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:24.589806 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:24.638425 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:24.638387 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:26.858729 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:26.858697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:26.947551 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:26.947513 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:27.219808 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:27.219722 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:29.482615 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:29.482585 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5gxkz" Jul 09 04:01:29.601166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:29.601130 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:29.655086 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:29.655055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:29.792874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:29.792848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:29.931362 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:29.931328 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.040488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.040456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.113047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.112976 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks"] Jul 09 04:01:30.115971 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.115953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.118595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.118571 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 04:01:30.118719 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.118573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 04:01:30.119801 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.119776 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b4dgh\"" Jul 09 04:01:30.119927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.119850 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 04:01:30.119927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.119892 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 04:01:30.120252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.120233 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 04:01:30.120337 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.120275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.132917 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.132883 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks"] Jul 09 04:01:30.168604 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.168567 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fr28n"] Jul 09 04:01:30.171085 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.171063 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.174193 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.174176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wpfxj\"" Jul 09 04:01:30.174409 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.174393 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 04:01:30.174597 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.174583 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 04:01:30.174654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.174621 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 04:01:30.192575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.192548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.192575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.192578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.192762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.192617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.192762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.192636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hcmd\" (UniqueName: \"kubernetes.io/projected/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-kube-api-access-5hcmd\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.258070 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.258037 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.293687 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hcmd\" (UniqueName: \"kubernetes.io/projected/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-kube-api-access-5hcmd\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-textfile\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-sys\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:01:30.293854 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 04:01:30.293893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-metrics-client-ca\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:01:30.293931 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls podName:c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:30.793912229 +0000 UTC m=+88.169743277 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-m75ks" (UID: "c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4") : secret "openshift-state-metrics-tls" not found Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.293976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-wtmp\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58j64\" (UniqueName: \"kubernetes.io/projected/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-kube-api-access-58j64\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-root\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.294580 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.294562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.296294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.296277 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.305836 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.305797 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hcmd\" (UniqueName: \"kubernetes.io/projected/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-kube-api-access-5hcmd\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.394567 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394567 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-root\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-textfile\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-sys\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-metrics-client-ca\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-sys\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-wtmp\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-root\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.394767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58j64\" (UniqueName: \"kubernetes.io/projected/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-kube-api-access-58j64\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-wtmp\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:01:30.394899 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:01:30.394984 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls podName:e42bb36e-a51a-4e57-bb7f-8028b2453ce0 nodeName:}" failed. No retries permitted until 2026-07-09 04:01:30.894961916 +0000 UTC m=+88.270792973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls") pod "node-exporter-fr28n" (UID: "e42bb36e-a51a-4e57-bb7f-8028b2453ce0") : secret "node-exporter-tls" not found Jul 09 04:01:30.395118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.394996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-textfile\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.395296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-metrics-client-ca\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.395356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.395304 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.396994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.396972 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.403576 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.403552 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58j64\" (UniqueName: \"kubernetes.io/projected/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-kube-api-access-58j64\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.422324 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.422293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.523146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.523112 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.624738 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.624699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.724021 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.723934 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:30.797457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.797421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.799942 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.799913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m75ks\" (UID: \"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:30.898160 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.898118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:30.900520 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:30.900495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e42bb36e-a51a-4e57-bb7f-8028b2453ce0-node-exporter-tls\") pod \"node-exporter-fr28n\" (UID: \"e42bb36e-a51a-4e57-bb7f-8028b2453ce0\") " pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:31.014141 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.014055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:31.025772 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.025749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" Jul 09 04:01:31.080405 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.080374 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fr28n" Jul 09 04:01:31.092698 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:31.092665 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42bb36e_a51a_4e57_bb7f_8028b2453ce0.slice/crio-42336e51ac075742d2ab33c9fc3aab1b6ab2a8a7cafc5a8eb3b8629729edc385 WatchSource:0}: Error finding container 42336e51ac075742d2ab33c9fc3aab1b6ab2a8a7cafc5a8eb3b8629729edc385: Status 404 returned error can't find the container with id 42336e51ac075742d2ab33c9fc3aab1b6ab2a8a7cafc5a8eb3b8629729edc385 Jul 09 04:01:31.096881 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.096852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:31.161857 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.161812 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks"] Jul 09 04:01:31.163741 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:31.163713 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bc9ba5_586c_4080_9a0f_cdf2d6c119c4.slice/crio-b626fbc05e0a138c222866c4cd20d60e8511664ca11207bbea91ea82faf0ddae WatchSource:0}: Error finding container b626fbc05e0a138c222866c4cd20d60e8511664ca11207bbea91ea82faf0ddae: Status 404 returned error can't find the container with id b626fbc05e0a138c222866c4cd20d60e8511664ca11207bbea91ea82faf0ddae Jul 09 04:01:31.197241 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.197206 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:31.518535 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.518486 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr28n" event={"ID":"e42bb36e-a51a-4e57-bb7f-8028b2453ce0","Type":"ContainerStarted","Data":"42336e51ac075742d2ab33c9fc3aab1b6ab2a8a7cafc5a8eb3b8629729edc385"} Jul 09 04:01:31.520281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.520214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" event={"ID":"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4","Type":"ContainerStarted","Data":"ab02e2649a24d630e41d56295e41a8e2f103354db4c6e428873cf71f651d4297"} Jul 09 04:01:31.520281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.520262 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" event={"ID":"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4","Type":"ContainerStarted","Data":"e0d8255ed9eb9402cef1c93eddd888285d9a2f66405c76113806cce42d5a5e20"} Jul 09 04:01:31.520281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:31.520280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" event={"ID":"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4","Type":"ContainerStarted","Data":"b626fbc05e0a138c222866c4cd20d60e8511664ca11207bbea91ea82faf0ddae"} Jul 09 04:01:32.526090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:32.526055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr28n" event={"ID":"e42bb36e-a51a-4e57-bb7f-8028b2453ce0","Type":"ContainerStarted","Data":"f4edbd2b6593f53d992b1e4a28847550070ffc0e8ffdb4b2a69d442a2ec430f9"} Jul 09 04:01:32.528604 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:32.528578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" event={"ID":"c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4","Type":"ContainerStarted","Data":"0b4ea0796f194abcb9b2944a82eea0fa6ab481ef939d4e763fea3ca2f4ec2aa0"} Jul 09 04:01:32.564590 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:32.564536 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m75ks" podStartSLOduration=1.430375667 podStartE2EDuration="2.564517689s" totalImagesPullingTime="1.134142022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:32.563544392 +0000 UTC m=+89.939375468" watchObservedRunningTime="2026-07-09 04:01:32.564517689 +0000 UTC m=+89.940348781" Jul 09 04:01:33.012413 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.012379 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:33.060119 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.060083 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:33.282278 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.282243 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:33.384858 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.384812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:33.533437 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.533341 2563 generic.go:356] "Generic (PLEG): container finished" podID="e42bb36e-a51a-4e57-bb7f-8028b2453ce0" containerID="f4edbd2b6593f53d992b1e4a28847550070ffc0e8ffdb4b2a69d442a2ec430f9" exitCode=0 Jul 09 04:01:33.533437 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.533376 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr28n" event={"ID":"e42bb36e-a51a-4e57-bb7f-8028b2453ce0","Type":"ContainerDied","Data":"f4edbd2b6593f53d992b1e4a28847550070ffc0e8ffdb4b2a69d442a2ec430f9"} Jul 09 04:01:33.856432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.856335 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:33.911533 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:33.911498 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:34.539158 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.539127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr28n" event={"ID":"e42bb36e-a51a-4e57-bb7f-8028b2453ce0","Type":"ContainerStarted","Data":"faef42a3739dae41722d232ea84a16d9f839a688716738ee3f339555a3ee2345"} Jul 09 04:01:34.539525 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.539211 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr28n" event={"ID":"e42bb36e-a51a-4e57-bb7f-8028b2453ce0","Type":"ContainerStarted","Data":"9816ae698f28e05bd719661ed80320f8cd0826b718eccf043eb0883f3026d047"} Jul 09 04:01:34.636416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.636368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:34.692603 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.692562 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:34.809595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.809492 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fr28n" podStartSLOduration=3.439703812 podStartE2EDuration="4.809473864s" totalImagesPullingTime="1.293308474s" totalInitContainerRuntime="76.461578ms" isStatefulPod=true podCreationTimestamp="2026-07-09 04:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:34.563140918 +0000 UTC m=+91.938971980" watchObservedRunningTime="2026-07-09 04:01:34.809473864 +0000 UTC m=+92.185304927" Jul 09 04:01:34.809802 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.809787 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx"] Jul 09 04:01:34.811845 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.811813 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:34.814242 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.814214 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bc4qz\"" Jul 09 04:01:34.814376 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.814249 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 04:01:34.816303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.816278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:34.822776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.822750 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx"] Jul 09 04:01:34.913000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.912964 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:34.930975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.930931 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e3ef09-8b53-4387-a05b-47e9e8314691-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:34.931105 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:34.931005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d445m\" (UniqueName: \"kubernetes.io/projected/a3e3ef09-8b53-4387-a05b-47e9e8314691-kube-api-access-d445m\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.013920 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.013883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:35.034048 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.034013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e3ef09-8b53-4387-a05b-47e9e8314691-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.034207 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.034070 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d445m\" (UniqueName: \"kubernetes.io/projected/a3e3ef09-8b53-4387-a05b-47e9e8314691-kube-api-access-d445m\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.036626 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.036603 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3e3ef09-8b53-4387-a05b-47e9e8314691-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.042699 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.042669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d445m\" (UniqueName: \"kubernetes.io/projected/a3e3ef09-8b53-4387-a05b-47e9e8314691-kube-api-access-d445m\") pod \"monitoring-plugin-d5dcff7cf-9nhtx\" (UID: \"a3e3ef09-8b53-4387-a05b-47e9e8314691\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.121608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.121523 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:35.269008 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.268963 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx"] Jul 09 04:01:35.272679 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:35.272652 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e3ef09_8b53_4387_a05b_47e9e8314691.slice/crio-7735adac90d552bd9171634727039332254002c5f2dcfbec59dba9de489fb168 WatchSource:0}: Error finding container 7735adac90d552bd9171634727039332254002c5f2dcfbec59dba9de489fb168: Status 404 returned error can't find the container with id 7735adac90d552bd9171634727039332254002c5f2dcfbec59dba9de489fb168 Jul 09 04:01:35.370997 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.370969 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx"] Jul 09 04:01:35.374717 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.374663 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.377445 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 04:01:35.377578 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 04:01:35.377578 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 04:01:35.377578 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 04:01:35.377787 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377768 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mr4mr\"" Jul 09 04:01:35.377900 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.377773 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 04:01:35.382719 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.382702 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 04:01:35.393628 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.393475 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx"] Jul 09 04:01:35.437671 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-federate-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437671 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-metrics-client-ca\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmv6l\" (UniqueName: \"kubernetes.io/projected/a10cd3b6-da36-4113-99e2-30b796548bce-kube-api-access-wmv6l\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-serving-certs-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.437979 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.437909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.538538 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.538496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-federate-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.538538 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.538534 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-metrics-client-ca\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.538751 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.538668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.538751 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.538715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.538892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.538763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmv6l\" (UniqueName: \"kubernetes.io/projected/a10cd3b6-da36-4113-99e2-30b796548bce-kube-api-access-wmv6l\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539110 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539178 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-serving-certs-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539370 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-metrics-client-ca\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539849 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.539916 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.539853 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a10cd3b6-da36-4113-99e2-30b796548bce-serving-certs-ca-bundle\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.541750 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.541729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.541892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.541798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-federate-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.542186 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.542167 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-telemeter-client-tls\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.542266 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.542245 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a10cd3b6-da36-4113-99e2-30b796548bce-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.543876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.543853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" event={"ID":"a3e3ef09-8b53-4387-a05b-47e9e8314691","Type":"ContainerStarted","Data":"7735adac90d552bd9171634727039332254002c5f2dcfbec59dba9de489fb168"} Jul 09 04:01:35.546972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.546955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmv6l\" (UniqueName: \"kubernetes.io/projected/a10cd3b6-da36-4113-99e2-30b796548bce-kube-api-access-wmv6l\") pod \"telemeter-client-6c4cb75b66-k5pxx\" (UID: \"a10cd3b6-da36-4113-99e2-30b796548bce\") " pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.684052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.683958 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" Jul 09 04:01:35.818152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:35.818121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx"] Jul 09 04:01:35.821596 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:01:35.821564 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10cd3b6_da36_4113_99e2_30b796548bce.slice/crio-89e61d837bfb0ba1a2604aba68d22c575f1886e7ec6e4ac6284b9d468ad08d37 WatchSource:0}: Error finding container 89e61d837bfb0ba1a2604aba68d22c575f1886e7ec6e4ac6284b9d468ad08d37: Status 404 returned error can't find the container with id 89e61d837bfb0ba1a2604aba68d22c575f1886e7ec6e4ac6284b9d468ad08d37 Jul 09 04:01:36.282699 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:36.282661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:36.549793 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:36.549705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" event={"ID":"a10cd3b6-da36-4113-99e2-30b796548bce","Type":"ContainerStarted","Data":"89e61d837bfb0ba1a2604aba68d22c575f1886e7ec6e4ac6284b9d468ad08d37"} Jul 09 04:01:37.555134 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:37.555096 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" event={"ID":"a3e3ef09-8b53-4387-a05b-47e9e8314691","Type":"ContainerStarted","Data":"16883324b6c52e26ca4e0576f284c9d7fe916ca8b93e3066af6ad65336c1b464"} Jul 09 04:01:37.555589 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:37.555270 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:37.560694 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:37.560663 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" Jul 09 04:01:37.571860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:37.571342 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9nhtx" podStartSLOduration=1.834580049 podStartE2EDuration="3.571322964s" totalImagesPullingTime="1.736742915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:37.570763896 +0000 UTC m=+94.946594960" watchObservedRunningTime="2026-07-09 04:01:37.571322964 +0000 UTC m=+94.947154029" Jul 09 04:01:38.559554 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:38.559520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" event={"ID":"a10cd3b6-da36-4113-99e2-30b796548bce","Type":"ContainerStarted","Data":"f0911ac42af384df335c798813b600574ca3a579159d5a5dc35b2b048d9df6d8"} Jul 09 04:01:38.826529 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:38.826398 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:38.880961 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:38.880930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:39.377416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.377382 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:39.436162 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.436134 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:39.568660 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.568592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" event={"ID":"a10cd3b6-da36-4113-99e2-30b796548bce","Type":"ContainerStarted","Data":"0a1341b52223b2f3375505b3fcd913159d2a6b852b20383bf00cbc7f3a71e521"} Jul 09 04:01:39.569071 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.568698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" event={"ID":"a10cd3b6-da36-4113-99e2-30b796548bce","Type":"ContainerStarted","Data":"71f9ca34975e08a5766700711adb89432c234363fe32af03ab30680769ae183d"} Jul 09 04:01:39.610321 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.610258 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c4cb75b66-k5pxx" podStartSLOduration=1.544045037 podStartE2EDuration="4.610241678s" totalImagesPullingTime="3.066196641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:39.610204515 +0000 UTC m=+96.986035582" watchObservedRunningTime="2026-07-09 04:01:39.610241678 +0000 UTC m=+96.986072738" Jul 09 04:01:39.612864 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.612813 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:39.714020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:39.713937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:40.112867 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:40.112817 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:40.166344 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:40.166316 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:40.439222 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:40.439143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:40.539574 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:40.539525 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:41.339278 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:41.339217 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:41.389409 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:41.389376 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:48.460868 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:48.460811 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:48.519419 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:48.519384 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:50.482946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:50.482920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7kvjw" Jul 09 04:01:51.681414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:51.681377 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:51.780310 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:51.780275 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:01:51.843351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:01:51.843315 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:03.804914 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:03.804874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:03.865011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:03.864979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:09.604580 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:09.604532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:09.700221 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:09.700181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:11.388910 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:11.388874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:46.187244 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:46.187204 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:46.244800 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:46.244766 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:52.143558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.143521 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 04:02:52.146346 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.146327 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.149019 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.148984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 04:02:52.149019 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149024 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 04:02:52.149222 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.148999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 04:02:52.149222 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.148999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m4htm\"" Jul 09 04:02:52.149222 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 04:02:52.149384 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 04:02:52.149493 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149475 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 04:02:52.149560 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149522 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 04:02:52.149609 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.149559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 04:02:52.153994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.153934 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 04:02:52.160148 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.160128 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 04:02:52.178340 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-volume\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178617 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178617 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178617 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrl5\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-kube-api-access-smrl5\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-web-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-out\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.178768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.178753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279314 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279270 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279314 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-volume\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.279575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrl5\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-kube-api-access-smrl5\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280021 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280021 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279622 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-web-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280021 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.279660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-out\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280175 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.280059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280924 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.280382 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.280924 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.280792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7563e6b4-2582-4f52-bb95-b2c81aa84e30-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.282743 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.282715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283167 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283141 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-out\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283470 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-config-volume\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283470 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.283793 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.283772 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.284492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.284471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.284790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.284763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7563e6b4-2582-4f52-bb95-b2c81aa84e30-web-config\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.288153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.288132 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrl5\" (UniqueName: \"kubernetes.io/projected/7563e6b4-2582-4f52-bb95-b2c81aa84e30-kube-api-access-smrl5\") pod \"alertmanager-main-0\" (UID: \"7563e6b4-2582-4f52-bb95-b2c81aa84e30\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.456161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.456062 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 04:02:52.594874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.594821 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 04:02:52.597524 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:02:52.597493 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7563e6b4_2582_4f52_bb95_b2c81aa84e30.slice/crio-0a1ff2e322109749b3df62e58b5d236e9a9f5a564e82c17ce5427d1241bf3e7d WatchSource:0}: Error finding container 0a1ff2e322109749b3df62e58b5d236e9a9f5a564e82c17ce5427d1241bf3e7d: Status 404 returned error can't find the container with id 0a1ff2e322109749b3df62e58b5d236e9a9f5a564e82c17ce5427d1241bf3e7d Jul 09 04:02:52.820094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.820055 2563 generic.go:356] "Generic (PLEG): container finished" podID="7563e6b4-2582-4f52-bb95-b2c81aa84e30" containerID="3fb487169f080dac5a6bdae1213572a24b74390bf79fc3ebec2f7a9345d3f246" exitCode=0 Jul 09 04:02:52.820263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.820142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerDied","Data":"3fb487169f080dac5a6bdae1213572a24b74390bf79fc3ebec2f7a9345d3f246"} Jul 09 04:02:52.820263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:52.820217 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"0a1ff2e322109749b3df62e58b5d236e9a9f5a564e82c17ce5427d1241bf3e7d"} Jul 09 04:02:55.833994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:55.833951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"9f933bd14d70f383f5f62cf59b271ec19b855a0fff244dda1fae9aa8028fb9bd"} Jul 09 04:02:55.834414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:55.834032 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"93ec99ca8818193470d575ef89ffc073c1437250902bd60e47155d68a69ca810"} Jul 09 04:02:55.834414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:55.834072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"c4f6362eab7143ab21fdce122ec0566bc36d3b71f8581ae27a3a3eeb3611ff29"} Jul 09 04:02:55.834414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:55.834112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"85a72795ba30c2babd1e8771b7556d86fec5c3e0c0acdb16a9fe73bb878d12d0"} Jul 09 04:02:55.834414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:55.834156 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"f15aa4a42006b0a92d254968b066595a75bee8265dd309ee3fad22d402504fc7"} Jul 09 04:02:56.841150 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:56.841116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7563e6b4-2582-4f52-bb95-b2c81aa84e30","Type":"ContainerStarted","Data":"8671b58fb04e8eb82e81143ef4edb15fd0dc0d0933009e5b7456b85c60b412d8"} Jul 09 04:02:56.868705 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:56.868649 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.8387037099999999 podStartE2EDuration="4.868633727s" totalImagesPullingTime="3.010264548s" totalInitContainerRuntime="19.665469ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:02:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:02:56.866490392 +0000 UTC m=+174.242321456" watchObservedRunningTime="2026-07-09 04:02:56.868633727 +0000 UTC m=+174.244464790" Jul 09 04:02:58.134987 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:58.134953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:02:58.235414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:02:58.235384 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:07.136138 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:07.136107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:09.597888 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:09.597849 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:09.696187 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:09.696149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:18.362091 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:18.362054 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:18.463208 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:18.463171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:18.617424 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:18.617334 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:24.498197 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:24.498162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:24.545326 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:24.545296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:30.010114 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:30.010076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:30.107794 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:30.107756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:56.629323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:56.629289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:57.438956 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:57.438919 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:03:58.600516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.600482 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9"] Jul 09 04:03:58.602700 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.602683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.605657 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.605624 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:03:58.605776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.605630 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bxgvj\"" Jul 09 04:03:58.605776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.605633 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 04:03:58.615416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.615395 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9"] Jul 09 04:03:58.681728 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.681692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjw4p\" (UniqueName: \"kubernetes.io/projected/922d237d-7529-4de9-9dea-c8af54a5108a-kube-api-access-vjw4p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.681920 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.681739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/922d237d-7529-4de9-9dea-c8af54a5108a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.783068 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.783021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/922d237d-7529-4de9-9dea-c8af54a5108a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.783181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.783138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjw4p\" (UniqueName: \"kubernetes.io/projected/922d237d-7529-4de9-9dea-c8af54a5108a-kube-api-access-vjw4p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.783505 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.783484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/922d237d-7529-4de9-9dea-c8af54a5108a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.792251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.792232 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjw4p\" (UniqueName: \"kubernetes.io/projected/922d237d-7529-4de9-9dea-c8af54a5108a-kube-api-access-vjw4p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nkjx9\" (UID: \"922d237d-7529-4de9-9dea-c8af54a5108a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:58.911285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:58.911197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" Jul 09 04:03:59.046053 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:59.046018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9"] Jul 09 04:03:59.051713 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:03:59.051682 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d237d_7529_4de9_9dea_c8af54a5108a.slice/crio-2e29613d3f34baaa674188bd5818b65c51dbebe5bce08ad4b94467f0b3621ebd WatchSource:0}: Error finding container 2e29613d3f34baaa674188bd5818b65c51dbebe5bce08ad4b94467f0b3621ebd: Status 404 returned error can't find the container with id 2e29613d3f34baaa674188bd5818b65c51dbebe5bce08ad4b94467f0b3621ebd Jul 09 04:03:59.062237 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:03:59.062210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" event={"ID":"922d237d-7529-4de9-9dea-c8af54a5108a","Type":"ContainerStarted","Data":"2e29613d3f34baaa674188bd5818b65c51dbebe5bce08ad4b94467f0b3621ebd"} Jul 09 04:04:00.232843 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:00.232795 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:00.333271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:00.333234 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:02.946189 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:02.946103 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:03.004810 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:03.004780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:03.080497 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:03.080461 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" event={"ID":"922d237d-7529-4de9-9dea-c8af54a5108a","Type":"ContainerStarted","Data":"d5d5a0cf7c0a78ec80aa8ccf127921cf76d9025dec418b55d941ce0cd03403fd"} Jul 09 04:04:03.102796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:03.102742 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nkjx9" podStartSLOduration=1.56888615 podStartE2EDuration="5.102726594s" totalImagesPullingTime="3.533840444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:03.100380803 +0000 UTC m=+240.476211861" watchObservedRunningTime="2026-07-09 04:04:03.102726594 +0000 UTC m=+240.478557656" Jul 09 04:04:03.434707 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:03.434669 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:03.561045 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:03.561011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:05.796907 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:05.796869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:05.989768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:05.989733 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:06.217468 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:06.217388 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:06.278712 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:06.278682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:07.134674 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.134642 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj"] Jul 09 04:04:07.137290 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.137267 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.140049 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.140028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 04:04:07.140161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.140028 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 04:04:07.141178 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.141162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pjdxz\"" Jul 09 04:04:07.151341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.151317 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj"] Jul 09 04:04:07.253220 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.253177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcgjw\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-kube-api-access-pcgjw\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.253387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.253255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.354282 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.354240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.354490 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.354300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcgjw\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-kube-api-access-pcgjw\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.369137 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.369110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.369272 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.369229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcgjw\" (UniqueName: \"kubernetes.io/projected/196c5164-527d-4e7a-b72b-5ba7acbdff6d-kube-api-access-pcgjw\") pod \"cert-manager-cainjector-559cdd8c87-nt4tj\" (UID: \"196c5164-527d-4e7a-b72b-5ba7acbdff6d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.445893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.445786 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" Jul 09 04:04:07.580312 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:07.580288 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj"] Jul 09 04:04:07.582643 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:04:07.582614 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod196c5164_527d_4e7a_b72b_5ba7acbdff6d.slice/crio-e2155062af54cacc72614f2eec3a82b6dbd537456352cc0fe2697bb8c055b8d4 WatchSource:0}: Error finding container e2155062af54cacc72614f2eec3a82b6dbd537456352cc0fe2697bb8c055b8d4: Status 404 returned error can't find the container with id e2155062af54cacc72614f2eec3a82b6dbd537456352cc0fe2697bb8c055b8d4 Jul 09 04:04:08.099608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:08.099566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" event={"ID":"196c5164-527d-4e7a-b72b-5ba7acbdff6d","Type":"ContainerStarted","Data":"e2155062af54cacc72614f2eec3a82b6dbd537456352cc0fe2697bb8c055b8d4"} Jul 09 04:04:12.118292 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:12.118245 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" event={"ID":"196c5164-527d-4e7a-b72b-5ba7acbdff6d","Type":"ContainerStarted","Data":"d431f2c4ac65e50e51be16b889cb3aa0866850aca9b1ef976dd24bf109ceabbb"} Jul 09 04:04:12.137549 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:12.137496 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nt4tj" podStartSLOduration=1.082345199 podStartE2EDuration="5.13748125s" totalImagesPullingTime="4.055136051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:12.136629264 +0000 UTC m=+249.512460327" watchObservedRunningTime="2026-07-09 04:04:12.13748125 +0000 UTC m=+249.513312313" Jul 09 04:04:12.440663 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:12.440576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:12.499419 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:12.499380 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:12.982149 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:12.982114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:15.744359 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:15.744318 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:15.843201 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:15.843164 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:17.543193 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.543161 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5"] Jul 09 04:04:17.545967 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.545949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.548649 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.548629 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 04:04:17.548649 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.548636 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 04:04:17.549883 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.549864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b88gk\"" Jul 09 04:04:17.553999 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.553975 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5"] Jul 09 04:04:17.632647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.632607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8356baa-e237-4896-aee5-2766534271ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.632647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.632650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxf7t\" (UniqueName: \"kubernetes.io/projected/d8356baa-e237-4896-aee5-2766534271ec-kube-api-access-gxf7t\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.733179 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.733140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8356baa-e237-4896-aee5-2766534271ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.733179 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.733182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxf7t\" (UniqueName: \"kubernetes.io/projected/d8356baa-e237-4896-aee5-2766534271ec-kube-api-access-gxf7t\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.733548 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.733522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8356baa-e237-4896-aee5-2766534271ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.741768 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.741732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxf7t\" (UniqueName: \"kubernetes.io/projected/d8356baa-e237-4896-aee5-2766534271ec-kube-api-access-gxf7t\") pod \"openshift-lws-operator-fd8ccff4c-vtdd5\" (UID: \"d8356baa-e237-4896-aee5-2766534271ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.855611 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.855518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" Jul 09 04:04:17.987115 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:17.987029 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5"] Jul 09 04:04:17.989753 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:04:17.989715 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8356baa_e237_4896_aee5_2766534271ec.slice/crio-d6a5ecb9377011ebe632ca96a83fde7275e631dfd0ed1fc8ff9cb1ca7c78ee1e WatchSource:0}: Error finding container d6a5ecb9377011ebe632ca96a83fde7275e631dfd0ed1fc8ff9cb1ca7c78ee1e: Status 404 returned error can't find the container with id d6a5ecb9377011ebe632ca96a83fde7275e631dfd0ed1fc8ff9cb1ca7c78ee1e Jul 09 04:04:18.142281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:18.142192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" event={"ID":"d8356baa-e237-4896-aee5-2766534271ec","Type":"ContainerStarted","Data":"d6a5ecb9377011ebe632ca96a83fde7275e631dfd0ed1fc8ff9cb1ca7c78ee1e"} Jul 09 04:04:21.157685 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:21.157645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" event={"ID":"d8356baa-e237-4896-aee5-2766534271ec","Type":"ContainerStarted","Data":"262c3277a7a78da11a7a251f680951fff0e0b348c89ec784698895aa968dbed5"} Jul 09 04:04:21.176366 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:21.176312 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtdd5" podStartSLOduration=1.651213866 podStartE2EDuration="4.176297553s" totalImagesPullingTime="2.525083687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:21.175112715 +0000 UTC m=+258.550943779" watchObservedRunningTime="2026-07-09 04:04:21.176297553 +0000 UTC m=+258.552128615" Jul 09 04:04:21.774039 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:21.773996 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:21.874890 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:21.874850 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:23.915689 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:23.915580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:32.592741 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:32.592695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:37.282513 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:37.282466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:37.416271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:37.416238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:37.896071 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:37.896034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.192846 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.192726 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.308181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.308149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.354900 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.354857 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl"] Jul 09 04:04:38.361032 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.361004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.364152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.364128 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 04:04:38.364353 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.364336 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 04:04:38.364429 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.364389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qqrfg\"" Jul 09 04:04:38.364525 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.364510 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 04:04:38.364584 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.364515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 04:04:38.378808 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.378778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl"] Jul 09 04:04:38.514551 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.514446 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-manifests\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.514551 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.514489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-tmp\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.514755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.514555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.514755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.514642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.514755 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.514691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn74s\" (UniqueName: \"kubernetes.io/projected/160af334-bb00-4171-93b3-d3a256a80d80-kube-api-access-rn74s\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.515052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.515031 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.615118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615086 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-manifests\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.615118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-tmp\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.615368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.615368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.615368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn74s\" (UniqueName: \"kubernetes.io/projected/160af334-bb00-4171-93b3-d3a256a80d80-kube-api-access-rn74s\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.615368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.615568 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.615522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-manifests\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.617558 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.617537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/160af334-bb00-4171-93b3-d3a256a80d80-tmp\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.617884 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.617860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-webhook-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.618074 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.618055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/160af334-bb00-4171-93b3-d3a256a80d80-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.625468 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.625445 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn74s\" (UniqueName: \"kubernetes.io/projected/160af334-bb00-4171-93b3-d3a256a80d80-kube-api-access-rn74s\") pod \"opendatahub-operator-controller-manager-67dd5f9985-s4ppl\" (UID: \"160af334-bb00-4171-93b3-d3a256a80d80\") " pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.671486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.671451 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:38.715525 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.715489 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.812950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.812916 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl"] Jul 09 04:04:38.816118 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:04:38.816089 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160af334_bb00_4171_93b3_d3a256a80d80.slice/crio-ed832447d4bb424839f50a5f84970c39463e50e6cfde737e4a39bec8ff46f7bb WatchSource:0}: Error finding container ed832447d4bb424839f50a5f84970c39463e50e6cfde737e4a39bec8ff46f7bb: Status 404 returned error can't find the container with id ed832447d4bb424839f50a5f84970c39463e50e6cfde737e4a39bec8ff46f7bb Jul 09 04:04:38.818870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.818820 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:38.899040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:38.899010 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:39.001205 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:39.001168 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:39.229337 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:39.229255 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" event={"ID":"160af334-bb00-4171-93b3-d3a256a80d80","Type":"ContainerStarted","Data":"ed832447d4bb424839f50a5f84970c39463e50e6cfde737e4a39bec8ff46f7bb"} Jul 09 04:04:42.245332 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:42.245295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" event={"ID":"160af334-bb00-4171-93b3-d3a256a80d80","Type":"ContainerStarted","Data":"361ae6bfbb66ba828bc6ffa7f11d46cdbee5e26b3a49410b2533f6a18665856a"} Jul 09 04:04:43.251181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:43.251084 2563 generic.go:356] "Generic (PLEG): container finished" podID="160af334-bb00-4171-93b3-d3a256a80d80" containerID="361ae6bfbb66ba828bc6ffa7f11d46cdbee5e26b3a49410b2533f6a18665856a" exitCode=0 Jul 09 04:04:43.251181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:43.251142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" event={"ID":"160af334-bb00-4171-93b3-d3a256a80d80","Type":"ContainerDied","Data":"361ae6bfbb66ba828bc6ffa7f11d46cdbee5e26b3a49410b2533f6a18665856a"} Jul 09 04:04:44.256786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:44.256751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" event={"ID":"160af334-bb00-4171-93b3-d3a256a80d80","Type":"ContainerStarted","Data":"7324686ed1232f4ee1d1f6563920fb1560bb0f0ff3f32e1b5f05d7e0f27f1277"} Jul 09 04:04:44.257167 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:44.256870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:44.278982 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:44.278926 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" podStartSLOduration=1.9674162609999999 podStartE2EDuration="6.278910633s" totalImagesPullingTime="3.293684443s" totalInitContainerRuntime="1.017809929s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:44.276515766 +0000 UTC m=+281.652346831" watchObservedRunningTime="2026-07-09 04:04:44.278910633 +0000 UTC m=+281.654741696" Jul 09 04:04:50.278427 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:50.278385 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:50.385764 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:50.385732 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:52.888031 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:52.887991 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:52.990702 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:52.990669 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:55.265603 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:55.265572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67dd5f9985-s4ppl" Jul 09 04:04:56.842466 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.842428 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d"] Jul 09 04:04:56.845475 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.845450 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.850372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.850353 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 04:04:56.850480 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.850401 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 04:04:56.850480 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.850466 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bd226\"" Jul 09 04:04:56.850595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.850584 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 04:04:56.857898 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.857876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d"] Jul 09 04:04:56.864845 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.864804 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4211823-c5e9-4598-abfb-6c9d6695de78-manager-config\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.864939 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.864854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-metrics-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.864939 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.864896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.864939 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.864915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpl27\" (UniqueName: \"kubernetes.io/projected/e4211823-c5e9-4598-abfb-6c9d6695de78-kube-api-access-zpl27\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.965676 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.965639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4211823-c5e9-4598-abfb-6c9d6695de78-manager-config\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.965676 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.965675 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-metrics-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.965960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.965700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.965960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.965724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpl27\" (UniqueName: \"kubernetes.io/projected/e4211823-c5e9-4598-abfb-6c9d6695de78-kube-api-access-zpl27\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.966307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.966283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e4211823-c5e9-4598-abfb-6c9d6695de78-manager-config\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.968249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.968222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-metrics-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.968523 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.968505 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4211823-c5e9-4598-abfb-6c9d6695de78-cert\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:56.974022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:56.974002 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpl27\" (UniqueName: \"kubernetes.io/projected/e4211823-c5e9-4598-abfb-6c9d6695de78-kube-api-access-zpl27\") pod \"lws-controller-manager-ff67c745d-vpk4d\" (UID: \"e4211823-c5e9-4598-abfb-6c9d6695de78\") " pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:57.154892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.154798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:57.238200 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.238169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:57.304949 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.304915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d"] Jul 09 04:04:57.309117 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:04:57.309085 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4211823_c5e9_4598_abfb_6c9d6695de78.slice/crio-6d10953dbbcf431cfdd9deca65b003164b65e24fd5e705a86274a04053b9db47 WatchSource:0}: Error finding container 6d10953dbbcf431cfdd9deca65b003164b65e24fd5e705a86274a04053b9db47: Status 404 returned error can't find the container with id 6d10953dbbcf431cfdd9deca65b003164b65e24fd5e705a86274a04053b9db47 Jul 09 04:04:57.319850 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.319805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" event={"ID":"e4211823-c5e9-4598-abfb-6c9d6695de78","Type":"ContainerStarted","Data":"6d10953dbbcf431cfdd9deca65b003164b65e24fd5e705a86274a04053b9db47"} Jul 09 04:04:57.334512 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.334472 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:57.738799 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.738763 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:57.947005 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:57.946967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:58.330800 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:58.329421 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:58.433167 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:58.433125 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:58.745893 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:58.745779 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:58.836851 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:58.835545 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:59.134358 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.134327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:59.197565 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.197529 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:59.341729 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.341696 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" event={"ID":"e4211823-c5e9-4598-abfb-6c9d6695de78","Type":"ContainerStarted","Data":"a944ec7a515798b5e606648bc63cf2d28500b9b9713d82f6a635c7c59db95703"} Jul 09 04:04:59.341949 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.341772 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:04:59.366232 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.366201 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pszg9"] Jul 09 04:04:59.369607 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.369592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.373233 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.373211 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 04:04:59.386144 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.386117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.386297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.386150 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wbv\" (UniqueName: \"kubernetes.io/projected/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-kube-api-access-k8wbv\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.398453 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.398404 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" podStartSLOduration=1.7336507289999998 podStartE2EDuration="3.398386486s" totalImagesPullingTime="1.664735757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:59.396893791 +0000 UTC m=+296.772724856" watchObservedRunningTime="2026-07-09 04:04:59.398386486 +0000 UTC m=+296.774217549" Jul 09 04:04:59.399021 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.399002 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pszg9"] Jul 09 04:04:59.430783 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.430737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:59.486533 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.486502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.486533 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.486537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wbv\" (UniqueName: \"kubernetes.io/projected/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-kube-api-access-k8wbv\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.486725 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:04:59.486642 2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 04:04:59.486725 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:04:59.486722 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs podName:f679d2f2-a2d5-4f7f-aaea-a6e1300be970 nodeName:}" failed. No retries permitted until 2026-07-09 04:04:59.986701489 +0000 UTC m=+297.362532548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs") pod "model-serving-api-54d89bd5fc-pszg9" (UID: "f679d2f2-a2d5-4f7f-aaea-a6e1300be970") : secret "model-serving-api-tls" not found Jul 09 04:04:59.496372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.496349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wbv\" (UniqueName: \"kubernetes.io/projected/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-kube-api-access-k8wbv\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.980796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.980764 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:04:59.990059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.990028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:04:59.992596 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:04:59.992578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f679d2f2-a2d5-4f7f-aaea-a6e1300be970-tls-certs\") pod \"model-serving-api-54d89bd5fc-pszg9\" (UID: \"f679d2f2-a2d5-4f7f-aaea-a6e1300be970\") " pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:05:00.279544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:00.279456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:05:00.359760 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:00.359729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:00.420185 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:00.420158 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pszg9"] Jul 09 04:05:00.423449 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:05:00.423417 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf679d2f2_a2d5_4f7f_aaea_a6e1300be970.slice/crio-de9dd671fe54727acf9db22d34e6a73f95e8b0b8df4b85f9b75e5633301ce2de WatchSource:0}: Error finding container de9dd671fe54727acf9db22d34e6a73f95e8b0b8df4b85f9b75e5633301ce2de: Status 404 returned error can't find the container with id de9dd671fe54727acf9db22d34e6a73f95e8b0b8df4b85f9b75e5633301ce2de Jul 09 04:05:01.353618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:01.353580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" event={"ID":"f679d2f2-a2d5-4f7f-aaea-a6e1300be970","Type":"ContainerStarted","Data":"de9dd671fe54727acf9db22d34e6a73f95e8b0b8df4b85f9b75e5633301ce2de"} Jul 09 04:05:02.360088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:02.360031 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" event={"ID":"f679d2f2-a2d5-4f7f-aaea-a6e1300be970","Type":"ContainerStarted","Data":"bfb70ff6fbdbe1674357fc4a0da5b6ab2c873e20561d30c0038b719769c85764"} Jul 09 04:05:02.360651 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:02.360134 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:05:02.377449 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:02.377394 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" podStartSLOduration=1.5590462999999999 podStartE2EDuration="3.377372987s" totalImagesPullingTime="1.818326687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:02.376781299 +0000 UTC m=+299.752612388" watchObservedRunningTime="2026-07-09 04:05:02.377372987 +0000 UTC m=+299.753204052" Jul 09 04:05:03.038848 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:03.038793 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:05:03.039294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:03.039270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:05:03.046049 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:03.046028 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 04:05:04.759006 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:04.758961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:05.494646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.494617 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t"] Jul 09 04:05:05.497776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.497745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.500598 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.500574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 04:05:05.500752 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.500688 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 04:05:05.501061 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.501042 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 04:05:05.501169 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.501047 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fjskp\"" Jul 09 04:05:05.512371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.512348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t"] Jul 09 04:05:05.538632 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.538820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.538820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.538820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.538820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedf00d3-b045-41f9-9464-e3836b1b69a2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.539035 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.539035 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.539035 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.539035 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.538970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87pqx\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-kube-api-access-87pqx\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639635 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedf00d3-b045-41f9-9464-e3836b1b69a2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.639874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.639899 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87pqx\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-kube-api-access-87pqx\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640095 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640138 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.640492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.641003 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.640961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eedf00d3-b045-41f9-9464-e3836b1b69a2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.647790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.646362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.647790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.646855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.650157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.650124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87pqx\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-kube-api-access-87pqx\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.650268 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.650159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eedf00d3-b045-41f9-9464-e3836b1b69a2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dlnn2t\" (UID: \"eedf00d3-b045-41f9-9464-e3836b1b69a2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.672930 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.672892 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q"] Jul 09 04:05:05.677373 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.677348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.680243 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.680216 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 04:05:05.680370 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.680216 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 04:05:05.680370 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.680255 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 04:05:05.680370 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.680368 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7wq2m\"" Jul 09 04:05:05.688735 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.688702 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q"] Jul 09 04:05:05.740795 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a810e86-ba77-43ec-8323-8badbc52d08b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.741020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.740994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9wb\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-kube-api-access-7v9wb\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.810414 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.810378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:05.841750 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841720 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9wb\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-kube-api-access-7v9wb\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.841946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.841946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a810e86-ba77-43ec-8323-8badbc52d08b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.841946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.842090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.842090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.841975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.842090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.842038 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.843027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.842992 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.844622 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.844596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.844750 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.844660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.844809 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.844774 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a810e86-ba77-43ec-8323-8badbc52d08b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.844889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.844865 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.855217 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.855187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.855364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.855236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9wb\" (UniqueName: \"kubernetes.io/projected/0a810e86-ba77-43ec-8323-8badbc52d08b-kube-api-access-7v9wb\") pod \"istiod-openshift-gateway-94bb8fbfd-jkd6q\" (UID: \"0a810e86-ba77-43ec-8323-8badbc52d08b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:05.917492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.917459 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:05.952242 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.952151 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t"] Jul 09 04:05:05.954316 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:05:05.954289 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedf00d3_b045_41f9_9464_e3836b1b69a2.slice/crio-8946bb8fcfaeadc4070ed7d35e448012bbf26d960f1b346a7490cd526b9e1cbd WatchSource:0}: Error finding container 8946bb8fcfaeadc4070ed7d35e448012bbf26d960f1b346a7490cd526b9e1cbd: Status 404 returned error can't find the container with id 8946bb8fcfaeadc4070ed7d35e448012bbf26d960f1b346a7490cd526b9e1cbd Jul 09 04:05:05.956401 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.956384 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 04:05:05.987965 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:05.987938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:06.128487 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:06.128456 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q"] Jul 09 04:05:06.131485 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:05:06.131452 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a810e86_ba77_43ec_8323_8badbc52d08b.slice/crio-43fe6529428ec09b519f0df1e3c1074517c862eea6a941d5506c2326076acd47 WatchSource:0}: Error finding container 43fe6529428ec09b519f0df1e3c1074517c862eea6a941d5506c2326076acd47: Status 404 returned error can't find the container with id 43fe6529428ec09b519f0df1e3c1074517c862eea6a941d5506c2326076acd47 Jul 09 04:05:06.378519 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:06.378423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" event={"ID":"eedf00d3-b045-41f9-9464-e3836b1b69a2","Type":"ContainerStarted","Data":"8946bb8fcfaeadc4070ed7d35e448012bbf26d960f1b346a7490cd526b9e1cbd"} Jul 09 04:05:06.379676 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:06.379647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" event={"ID":"0a810e86-ba77-43ec-8323-8badbc52d08b","Type":"ContainerStarted","Data":"43fe6529428ec09b519f0df1e3c1074517c862eea6a941d5506c2326076acd47"} Jul 09 04:05:08.516621 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:08.516518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:08.657543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:08.657507 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:08.806114 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:08.806076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:08.896103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:08.896071 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:08.994432 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:08.994395 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:09.102172 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.102087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:09.714064 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.714006 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:05:09.714378 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.714095 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:05:09.714378 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.714154 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:05:09.717294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.716603 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:05:09.717294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:09.716669 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:05:10.349770 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.349741 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-ff67c745d-vpk4d" Jul 09 04:05:10.404323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.404283 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" event={"ID":"eedf00d3-b045-41f9-9464-e3836b1b69a2","Type":"ContainerStarted","Data":"305bcdab4b77cbf1170efd592971115c9f84eba192ac5932c6d00325ff5a0991"} Jul 09 04:05:10.405836 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.405795 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" event={"ID":"0a810e86-ba77-43ec-8323-8badbc52d08b","Type":"ContainerStarted","Data":"19789c3a15d1afca80d867ec7b9e2bda0099bfdc6c93fa1a270d8217245a4e1a"} Jul 09 04:05:10.406015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.405999 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:10.407667 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.407630 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-jkd6q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 04:05:10.407791 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.407692 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" podUID="0a810e86-ba77-43ec-8323-8badbc52d08b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:05:10.445796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.445724 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" podStartSLOduration=1.688487125 podStartE2EDuration="5.445701909s" totalImagesPullingTime="3.757214784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:10.444229494 +0000 UTC m=+307.820060558" watchObservedRunningTime="2026-07-09 04:05:10.445701909 +0000 UTC m=+307.821532975" Jul 09 04:05:10.494717 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.494664 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" podStartSLOduration=1.911899366 podStartE2EDuration="5.494648384s" totalImagesPullingTime="3.582749018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:10.492514619 +0000 UTC m=+307.868345681" watchObservedRunningTime="2026-07-09 04:05:10.494648384 +0000 UTC m=+307.870479446" Jul 09 04:05:10.811120 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.811077 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:10.815607 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:10.815579 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:11.410526 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:11.410474 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:11.411125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:11.411098 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jkd6q" Jul 09 04:05:11.411385 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:11.411370 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dlnn2t" Jul 09 04:05:13.369769 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:13.369742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pszg9" Jul 09 04:05:58.677236 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:58.677148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:58.786054 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:58.786023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:58.904518 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:58.904479 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:59.607787 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:59.607745 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:05:59.814176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:05:59.814144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:24.202820 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:24.202787 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:27.678015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:27.677977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:29.604246 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:29.604205 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:31.436324 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:31.436244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:31.599648 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:31.599600 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:33.892804 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:33.892773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:34.006377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:34.006348 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:34.801790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:34.801738 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:36.227039 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:36.226998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:36.326957 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:36.326921 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:39.203630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:39.203593 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:39.262961 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:39.262928 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:39.718469 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:39.718432 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:46.851806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:46.851762 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:46.969677 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:46.969641 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:51.673982 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:51.673943 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:51.806232 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:51.806199 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:56.445938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:56.445902 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:56.544246 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:56.544210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:06:59.990309 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:06:59.990256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.094703 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.094665 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.249936 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.249851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.353112 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.353076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.625243 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.625207 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.725091 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.725058 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:00.826889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:00.826844 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:07.810582 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:07.810541 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:07.862200 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:07.862161 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:11.272490 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:11.272450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:11.375712 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:11.375680 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:12.028266 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:12.028230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:12.129223 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:12.129189 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:12.228532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:12.228497 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:12.329515 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:12.329483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:14.176644 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:14.176614 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:14.234867 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:14.234821 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:16.831812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:16.831780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:16.941858 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:16.941806 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:20.380328 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:20.380292 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:20.511943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:20.511898 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:25.326801 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:25.326719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:25.413291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:25.413259 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:25.514041 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:25.514000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:26.259663 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:26.259623 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:26.349399 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:26.349368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:46.505278 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:46.505235 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:46.600242 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:46.600203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:46.987399 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:46.987365 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:58.629374 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:58.629337 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:07:58.729416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:07:58.729383 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:04.917163 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:04.917124 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:05.015710 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:05.015666 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:05.068727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:05.068697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:05.132759 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:05.132729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:07.781815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:07.781773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:07.914996 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:07.914961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:13.371479 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:13.371446 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:23.771885 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:23.771848 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:23.823189 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:23.823159 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:28.392758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:28.392720 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:40.185555 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:40.185518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:40.664334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:40.664277 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:40.935304 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:40.935208 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:41.194305 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.194196 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:41.302154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.302115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:41.334481 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.334447 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zv6tt"] Jul 09 04:08:41.337788 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.337771 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.340200 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.340180 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pxrp4\"" Jul 09 04:08:41.340310 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.340206 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 04:08:41.347396 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.347371 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zv6tt"] Jul 09 04:08:41.418425 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.418393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rplhb\" (UniqueName: \"kubernetes.io/projected/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-kube-api-access-rplhb\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.418606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.418463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-plugins-config-volume\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.519965 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.519862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rplhb\" (UniqueName: \"kubernetes.io/projected/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-kube-api-access-rplhb\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.520133 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.520031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-plugins-config-volume\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.520708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.520688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-plugins-config-volume\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.528763 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.528735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rplhb\" (UniqueName: \"kubernetes.io/projected/bf5fd576-73fa-4919-9ad7-eabe654ebe1d-kube-api-access-rplhb\") pod \"payload-processing-58f86c7798-zv6tt\" (UID: \"bf5fd576-73fa-4919-9ad7-eabe654ebe1d\") " pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.648557 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.648521 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:41.781020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:41.780967 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zv6tt"] Jul 09 04:08:41.783167 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:08:41.783137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5fd576_73fa_4919_9ad7_eabe654ebe1d.slice/crio-fc0f402a6997971ea9248e2ff417887f494a7f980a3e10ffec3ab2c9be06d2a8 WatchSource:0}: Error finding container fc0f402a6997971ea9248e2ff417887f494a7f980a3e10ffec3ab2c9be06d2a8: Status 404 returned error can't find the container with id fc0f402a6997971ea9248e2ff417887f494a7f980a3e10ffec3ab2c9be06d2a8 Jul 09 04:08:42.330894 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:42.330862 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" event={"ID":"bf5fd576-73fa-4919-9ad7-eabe654ebe1d","Type":"ContainerStarted","Data":"fc0f402a6997971ea9248e2ff417887f494a7f980a3e10ffec3ab2c9be06d2a8"} Jul 09 04:08:43.337062 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:43.336964 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" event={"ID":"bf5fd576-73fa-4919-9ad7-eabe654ebe1d","Type":"ContainerStarted","Data":"7a00c61a608717ca52bc71693e0c705c82e4c11d9c2d8c8347d9bd691d6927fa"} Jul 09 04:08:43.337062 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:43.337029 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:08:43.353993 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:43.353939 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" podStartSLOduration=1.060307291 podStartE2EDuration="2.353922523s" totalImagesPullingTime="1.293615232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:08:43.351630148 +0000 UTC m=+520.727461210" watchObservedRunningTime="2026-07-09 04:08:43.353922523 +0000 UTC m=+520.729753586" Jul 09 04:08:51.650301 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:51.650266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:51.752471 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:51.752437 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:08:54.343083 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:08:54.343004 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zv6tt" Jul 09 04:09:05.050000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:05.049962 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:10.837692 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.837658 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr"] Jul 09 04:09:10.841290 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.841268 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.845249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.845220 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 04:09:10.845249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.845231 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 04:09:10.845447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.845274 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-j7ms6\"" Jul 09 04:09:10.845447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.845274 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 04:09:10.850287 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.850262 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr"] Jul 09 04:09:10.865189 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.865325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.865325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865245 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da764d5f-da67-4352-8d5a-0217531e0723-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.865325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.865325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hltjx\" (UniqueName: \"kubernetes.io/projected/da764d5f-da67-4352-8d5a-0217531e0723-kube-api-access-hltjx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.865325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.865321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.869159 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.869131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:10.965783 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.965975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.965975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.965975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da764d5f-da67-4352-8d5a-0217531e0723-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.965975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.965975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.965970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hltjx\" (UniqueName: \"kubernetes.io/projected/da764d5f-da67-4352-8d5a-0217531e0723-kube-api-access-hltjx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.966294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.966265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.966407 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.966310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.966407 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.966369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.968380 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.968357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da764d5f-da67-4352-8d5a-0217531e0723-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.968541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.968524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da764d5f-da67-4352-8d5a-0217531e0723-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:10.974809 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:10.974781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hltjx\" (UniqueName: \"kubernetes.io/projected/da764d5f-da67-4352-8d5a-0217531e0723-kube-api-access-hltjx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cvpfr\" (UID: \"da764d5f-da67-4352-8d5a-0217531e0723\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:11.152099 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:11.152000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:11.292560 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:11.292532 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr"] Jul 09 04:09:11.295412 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:09:11.295387 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda764d5f_da67_4352_8d5a_0217531e0723.slice/crio-5a1dce16206634bbf380d54b600fde455d160897fb497ec8889d14137324420e WatchSource:0}: Error finding container 5a1dce16206634bbf380d54b600fde455d160897fb497ec8889d14137324420e: Status 404 returned error can't find the container with id 5a1dce16206634bbf380d54b600fde455d160897fb497ec8889d14137324420e Jul 09 04:09:11.460468 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:11.460377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" event={"ID":"da764d5f-da67-4352-8d5a-0217531e0723","Type":"ContainerStarted","Data":"5a1dce16206634bbf380d54b600fde455d160897fb497ec8889d14137324420e"} Jul 09 04:09:12.466912 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:12.466876 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" event={"ID":"da764d5f-da67-4352-8d5a-0217531e0723","Type":"ContainerStarted","Data":"54b83863a6fb43c5f961ba7add9537b342bf956dad91aeeb0f949ecc48f6e56d"} Jul 09 04:09:12.486475 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:12.486425 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" podStartSLOduration=1.456463066 podStartE2EDuration="2.486408442s" totalImagesPullingTime="1.029945376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:09:12.485603846 +0000 UTC m=+549.861434909" watchObservedRunningTime="2026-07-09 04:09:12.486408442 +0000 UTC m=+549.862239509" Jul 09 04:09:21.152562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:21.152519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:21.153171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:21.152588 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:21.165530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:21.165497 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:21.516817 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:21.516734 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cvpfr" Jul 09 04:09:25.872639 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:25.872603 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:37.078245 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:37.078210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:49.327608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.327578 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9"] Jul 09 04:09:49.332997 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.332975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.335699 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.335669 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 04:09:49.345606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.345576 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9"] Jul 09 04:09:49.355667 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.355640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:49.507734 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzw5g\" (UniqueName: \"kubernetes.io/projected/d75983f0-259b-4244-9cd0-c2b2a9f2d603-kube-api-access-xzw5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.507951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.507951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.507951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.507951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.508148 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.507976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609160 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzw5g\" (UniqueName: \"kubernetes.io/projected/d75983f0-259b-4244-9cd0-c2b2a9f2d603-kube-api-access-xzw5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609163 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609334 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.609761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.609710 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.611726 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.611703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75983f0-259b-4244-9cd0-c2b2a9f2d603-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.611929 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.611909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75983f0-259b-4244-9cd0-c2b2a9f2d603-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.616647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.616623 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzw5g\" (UniqueName: \"kubernetes.io/projected/d75983f0-259b-4244-9cd0-c2b2a9f2d603-kube-api-access-xzw5g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-j55n9\" (UID: \"d75983f0-259b-4244-9cd0-c2b2a9f2d603\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.644523 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.644493 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:49.779989 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:49.779963 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9"] Jul 09 04:09:49.782013 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:09:49.781984 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75983f0_259b_4244_9cd0_c2b2a9f2d603.slice/crio-161cc840678735ee3275874932caca749ba061d8545cb0e46e61da1f1f99dd32 WatchSource:0}: Error finding container 161cc840678735ee3275874932caca749ba061d8545cb0e46e61da1f1f99dd32: Status 404 returned error can't find the container with id 161cc840678735ee3275874932caca749ba061d8545cb0e46e61da1f1f99dd32 Jul 09 04:09:50.640142 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:50.640105 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" event={"ID":"d75983f0-259b-4244-9cd0-c2b2a9f2d603","Type":"ContainerStarted","Data":"b5fec711356518e549e5347f160ddc0602f9b6eee3d3801dd332bce527dc9cfe"} Jul 09 04:09:50.640532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:50.640158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" event={"ID":"d75983f0-259b-4244-9cd0-c2b2a9f2d603","Type":"ContainerStarted","Data":"161cc840678735ee3275874932caca749ba061d8545cb0e46e61da1f1f99dd32"} Jul 09 04:09:50.661959 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:50.661905 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" podStartSLOduration=1.483514119 podStartE2EDuration="1.661888221s" totalImagesPullingTime="178.374102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:09:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:09:50.660168635 +0000 UTC m=+588.035999699" watchObservedRunningTime="2026-07-09 04:09:50.661888221 +0000 UTC m=+588.037719288" Jul 09 04:09:56.469157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:56.469115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:56.522067 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:56.522038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:09:59.645078 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:59.645025 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:59.645488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:59.645106 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:59.657685 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:59.657654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:09:59.691205 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:09:59.691162 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-j55n9" Jul 09 04:10:02.835729 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:02.835682 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:10:03.066394 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:03.066366 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:10:03.067289 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:03.067266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:10:04.674402 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:04.674372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:10:08.565313 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:08.565271 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:10:12.588577 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:10:12.588532 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:11:22.057053 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:11:22.057022 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:11:22.158168 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:11:22.158132 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:11:23.218819 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:11:23.218783 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:11:23.312902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:11:23.312814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:12:09.879275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:12:09.879236 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:12:33.215577 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:12:33.215537 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:12:34.582150 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:12:34.582105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:17.584321 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:17.584285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:17.683397 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:17.683366 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:17.819544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:17.819517 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:23.635365 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:23.635324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:23.687212 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:23.687169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:23.813015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:23.812981 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:23.912929 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:23.912803 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:24.017269 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:24.017229 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:29.858890 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:29.858851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:13:29.912603 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:13:29.912570 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:15:03.091996 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:15:03.091964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:15:03.097285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:15:03.097264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:15:36.251235 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:15:36.251197 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:16:52.538981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:16:52.538893 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:19:10.781457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:19:10.781411 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:19:10.871545 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:19:10.871499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:19:32.648283 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:19:32.648186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:19:32.701880 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:19:32.701810 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:20:03.118391 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:20:03.118357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:20:03.124732 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:20:03.124711 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:24:19.504374 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:19.504333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:26.128656 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:26.128611 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:34.406952 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:34.406914 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:39.540088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:39.540048 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:42.493876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:42.493818 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:42.604804 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:42.604763 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:42.972033 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:42.971999 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:48.858687 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:48.858651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:48.959523 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:48.959482 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:49.047276 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.047239 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:24:49.051082 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.051064 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.053754 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.053731 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b4276fe1-openshift-default-dockercfg-jkxl7\"" Jul 09 04:24:49.069486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.069456 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:24:49.083547 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.083509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:49.144037 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.143938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144037 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.143990 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144267 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144267 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144267 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144379 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144450 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54h6\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.144633 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.144612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.181609 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.181578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:49.245319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54h6\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245491 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245582 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.245946 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.245891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.246042 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.246017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.246166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.246029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.246297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.246275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.246355 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.246286 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.247804 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.247782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.248207 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.248188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.253678 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.253651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.254155 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.254136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54h6\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6\") pod \"e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.362790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.362755 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:49.506241 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.506215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:24:49.508844 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:24:49.508793 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eca783_0b69_4f5f_a346_b7fc4f3c1783.slice/crio-ef9cd61de1ec01a58d6312415b696dc76e1ba350dfaa90166d9051e6acfffba4 WatchSource:0}: Error finding container ef9cd61de1ec01a58d6312415b696dc76e1ba350dfaa90166d9051e6acfffba4: Status 404 returned error can't find the container with id ef9cd61de1ec01a58d6312415b696dc76e1ba350dfaa90166d9051e6acfffba4 Jul 09 04:24:49.510891 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.510863 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:24:49.510959 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.510933 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:24:49.510994 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.510958 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:24:49.704943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.704853 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" event={"ID":"f8eca783-0b69-4f5f-a346-b7fc4f3c1783","Type":"ContainerStarted","Data":"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4"} Jul 09 04:24:49.704943 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.704930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" event={"ID":"f8eca783-0b69-4f5f-a346-b7fc4f3c1783","Type":"ContainerStarted","Data":"ef9cd61de1ec01a58d6312415b696dc76e1ba350dfaa90166d9051e6acfffba4"} Jul 09 04:24:49.724263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:49.724209 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" podStartSLOduration=0.724191571 podStartE2EDuration="724.191571ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:49.722516982 +0000 UTC m=+1487.098348058" watchObservedRunningTime="2026-07-09 04:24:49.724191571 +0000 UTC m=+1487.100022634" Jul 09 04:24:50.200143 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.200107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:50.363161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.363123 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:50.364002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.363966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:50.368160 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.368134 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:50.456937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.456850 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:50.709425 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.709332 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:50.710418 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.710396 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:24:50.739844 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.739806 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:50.847895 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.847858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:50.948698 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:50.948660 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:52.645239 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:52.645204 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:55.339796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.339752 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:55.517433 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.517400 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:24:55.517648 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.517615 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" podUID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" containerName="istio-proxy" containerID="cri-o://a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4" gracePeriod=30 Jul 09 04:24:55.541530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.541497 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:55.645795 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.645702 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:55.702429 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:55.702394 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:24:57.303419 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:24:57.303380 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:01.822538 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.822473 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:01.960850 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.960807 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:01.963295 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.963271 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:01.966163 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.966108 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-278ee172-openshift-default-dockercfg-8r8rb\"" Jul 09 04:25:01.968725 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.968702 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:25:01.978980 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.978955 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:01.989766 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:01.989729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:02.054341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.054300 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:02.064187 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064153 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064384 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064204 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064384 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064304 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064506 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064393 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064506 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064465 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064506 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064467 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:02.064664 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064518 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064664 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064542 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d54h6\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064664 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064574 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064664 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064599 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs\") pod \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\" (UID: \"f8eca783-0b69-4f5f-a346-b7fc4f3c1783\") " Jul 09 04:25:02.064892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.064892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.064951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnkf\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.065015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.065087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065474 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.065399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.065726 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.065642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.066041 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.065951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.066259 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.066163 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.066490 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.066453 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:02.066579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.066509 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:02.067105 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.067081 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:25:02.067424 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.067400 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:02.068030 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.068005 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:02.068140 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.068128 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:25:02.068231 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.068208 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:02.069096 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.069078 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6" (OuterVolumeSpecName: "kube-api-access-d54h6") pod "f8eca783-0b69-4f5f-a346-b7fc4f3c1783" (UID: "f8eca783-0b69-4f5f-a346-b7fc4f3c1783"). InnerVolumeSpecName "kube-api-access-d54h6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:02.166796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.166796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnkf\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.166955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167118 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167132 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167145 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167159 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167172 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d54h6\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-kube-api-access-d54h6\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167185 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167197 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167207 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8eca783-0b69-4f5f-a346-b7fc4f3c1783-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:02.167387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167791 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167791 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167791 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.167791 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.167647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.169360 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.169336 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.169703 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.169678 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.175284 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.175254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnkf\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.175368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.175291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token\") pod \"e2e-ait-278ee172-openshift-default-5679576545-hvwpv\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.278590 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.278543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:02.417239 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.417204 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:02.420265 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:25:02.420236 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97dce82_dcd4_4445_86aa_1e1341ea8d70.slice/crio-33763bb651b269442c89bbd96a25c1349f8b94e6e983f1548d2a697e6a50c53e WatchSource:0}: Error finding container 33763bb651b269442c89bbd96a25c1349f8b94e6e983f1548d2a697e6a50c53e: Status 404 returned error can't find the container with id 33763bb651b269442c89bbd96a25c1349f8b94e6e983f1548d2a697e6a50c53e Jul 09 04:25:02.422271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.422237 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:02.422345 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.422308 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:02.422345 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.422338 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:02.768773 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.768690 2563 generic.go:356] "Generic (PLEG): container finished" podID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" containerID="a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4" exitCode=0 Jul 09 04:25:02.768773 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.768755 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" Jul 09 04:25:02.769015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.768794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" event={"ID":"f8eca783-0b69-4f5f-a346-b7fc4f3c1783","Type":"ContainerDied","Data":"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4"} Jul 09 04:25:02.769015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.768899 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k" event={"ID":"f8eca783-0b69-4f5f-a346-b7fc4f3c1783","Type":"ContainerDied","Data":"ef9cd61de1ec01a58d6312415b696dc76e1ba350dfaa90166d9051e6acfffba4"} Jul 09 04:25:02.769015 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.768933 2563 scope.go:117] "RemoveContainer" containerID="a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4" Jul 09 04:25:02.771145 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.771116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerStarted","Data":"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4"} Jul 09 04:25:02.771261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.771174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerStarted","Data":"33763bb651b269442c89bbd96a25c1349f8b94e6e983f1548d2a697e6a50c53e"} Jul 09 04:25:02.785854 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.785814 2563 scope.go:117] "RemoveContainer" containerID="a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4" Jul 09 04:25:02.786287 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:25:02.786266 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4\": container with ID starting with a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4 not found: ID does not exist" containerID="a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4" Jul 09 04:25:02.786359 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.786295 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4"} err="failed to get container status \"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4\": rpc error: code = NotFound desc = could not find container \"a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4\": container with ID starting with a38afdbdead995ef92bce8fdc6ca2434ca8f7f55e597a2dfb05a36d3611427b4 not found: ID does not exist" Jul 09 04:25:02.795931 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.795891 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" podStartSLOduration=1.79587648 podStartE2EDuration="1.79587648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:25:02.794190949 +0000 UTC m=+1500.170022012" watchObservedRunningTime="2026-07-09 04:25:02.79587648 +0000 UTC m=+1500.171707542" Jul 09 04:25:02.807510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.807482 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:25:02.810583 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:02.810559 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b4276fe1-openshift-default-5785cf9cb9-8fp9k"] Jul 09 04:25:03.139775 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.139734 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" path="/var/lib/kubelet/pods/f8eca783-0b69-4f5f-a346-b7fc4f3c1783/volumes" Jul 09 04:25:03.153647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.153610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:25:03.157966 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.157941 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:25:03.278903 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.278859 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:03.283453 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.283417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:03.284138 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.284120 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:03.383182 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.383126 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:03.504925 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.504814 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:03.776050 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.775966 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:03.777386 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.777359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:03.839516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.839484 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:03.944699 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:03.944656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:05.298723 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:05.298690 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:07.728689 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:07.728647 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:08.264531 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:08.264490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:08.612903 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:08.612861 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:13.830278 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.830242 2563 generic.go:356] "Generic (PLEG): container finished" podID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerID="a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4" exitCode=0 Jul 09 04:25:13.830772 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.830315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerDied","Data":"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4"} Jul 09 04:25:13.830865 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.830783 2563 scope.go:117] "RemoveContainer" containerID="a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4" Jul 09 04:25:13.831897 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.831868 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:13.831972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.831936 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:13.831972 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:13.831967 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:14.392802 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:14.392760 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:14.416330 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:14.416293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:14.518502 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:14.518468 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:14.837576 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:14.837537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerStarted","Data":"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb"} Jul 09 04:25:14.838020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:14.837593 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" containerID="cri-o://49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb" gracePeriod=30 Jul 09 04:25:15.994608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:15.994574 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:18.776269 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:18.776233 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:20.089546 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.089518 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:20.241761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241658 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.241761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241719 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.241761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241756 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241861 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmnkf\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241914 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241942 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.241974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242000 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242041 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert\") pod \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\" (UID: \"d97dce82-dcd4-4445-86aa-1e1341ea8d70\") " Jul 09 04:25:20.242371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242243 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:20.242371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242257 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:20.242371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242305 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:20.242859 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.242701 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:25:20.243398 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.243371 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data" (OuterVolumeSpecName: "istio-data") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:20.244169 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.244134 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:25:20.244247 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.244194 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:20.244294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.244266 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf" (OuterVolumeSpecName: "kube-api-access-lmnkf") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "kube-api-access-lmnkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:20.244618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.244598 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token" (OuterVolumeSpecName: "istio-token") pod "d97dce82-dcd4-4445-86aa-1e1341ea8d70" (UID: "d97dce82-dcd4-4445-86aa-1e1341ea8d70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:20.304894 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.304851 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:20.342948 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342918 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.342948 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342950 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmnkf\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-kube-api-access-lmnkf\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342961 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342970 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342978 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342986 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.342994 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.343002 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.343125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.343009 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d97dce82-dcd4-4445-86aa-1e1341ea8d70-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:20.364205 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.364167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:20.473488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.473440 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:20.474070 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474040 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" containerName="istio-proxy" Jul 09 04:25:20.474070 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474070 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474100 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474109 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474119 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474127 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474222 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:25:20.474270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.474235 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eca783-0b69-4f5f-a346-b7fc4f3c1783" containerName="istio-proxy" Jul 09 04:25:20.476841 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.476801 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.479604 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.479579 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-aeb5be87-openshift-default-dockercfg-mm2t6\"" Jul 09 04:25:20.490600 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.490571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:20.515349 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.515316 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:20.544273 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24v5\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544519 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.544679 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.544578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.587928 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.587863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:20.645761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.645761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645866 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24v5\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646011 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.645987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646447 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646441 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646556 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646507 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.646872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.646847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.648319 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.648299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.648593 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.648574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.654038 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.654017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.654192 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.654175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24v5\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5\") pod \"e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.789094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.789059 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:20.867984 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.867945 2563 generic.go:356] "Generic (PLEG): container finished" podID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerID="49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb" exitCode=0 Jul 09 04:25:20.868151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.867989 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" Jul 09 04:25:20.868151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.868018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerDied","Data":"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb"} Jul 09 04:25:20.868151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.868070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv" event={"ID":"d97dce82-dcd4-4445-86aa-1e1341ea8d70","Type":"ContainerDied","Data":"33763bb651b269442c89bbd96a25c1349f8b94e6e983f1548d2a697e6a50c53e"} Jul 09 04:25:20.868151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.868091 2563 scope.go:117] "RemoveContainer" containerID="49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb" Jul 09 04:25:20.877704 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.877678 2563 scope.go:117] "RemoveContainer" containerID="a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4" Jul 09 04:25:20.887000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.886970 2563 scope.go:117] "RemoveContainer" containerID="49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb" Jul 09 04:25:20.887354 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:25:20.887333 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb\": container with ID starting with 49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb not found: ID does not exist" containerID="49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb" Jul 09 04:25:20.887454 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.887366 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb"} err="failed to get container status \"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb\": rpc error: code = NotFound desc = could not find container \"49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb\": container with ID starting with 49a0c88f0b3e728c92fe9bfbc47ec2380e3c5a33fd42e8b4a4ab52a9105fb8cb not found: ID does not exist" Jul 09 04:25:20.887454 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.887392 2563 scope.go:117] "RemoveContainer" containerID="a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4" Jul 09 04:25:20.887678 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:25:20.887660 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4\": container with ID starting with a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4 not found: ID does not exist" containerID="a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4" Jul 09 04:25:20.887726 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.887686 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4"} err="failed to get container status \"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4\": rpc error: code = NotFound desc = could not find container \"a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4\": container with ID starting with a56497f7370dd4c04c02baa17e34ae77c46a15bf1af6e461e3b2abc26fe46ce4 not found: ID does not exist" Jul 09 04:25:20.891165 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.891135 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:20.895941 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.895914 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-278ee172-openshift-default-5679576545-hvwpv"] Jul 09 04:25:20.932595 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.932521 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:20.934863 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:25:20.934815 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b227c4d_e0f2_4c81_8861_9a76b1adf8eb.slice/crio-e8efa8d4f216bf5b33e506b4435e964e8147848ddda47205bedb7e47d6d79549 WatchSource:0}: Error finding container e8efa8d4f216bf5b33e506b4435e964e8147848ddda47205bedb7e47d6d79549: Status 404 returned error can't find the container with id e8efa8d4f216bf5b33e506b4435e964e8147848ddda47205bedb7e47d6d79549 Jul 09 04:25:20.937167 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.937135 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:20.937263 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.937215 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:20.937323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:20.937261 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:25:21.135577 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.135491 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" path="/var/lib/kubelet/pods/d97dce82-dcd4-4445-86aa-1e1341ea8d70/volumes" Jul 09 04:25:21.612081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.612040 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:21.692181 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.692143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:21.758088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.758052 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:21.877776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.877676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" event={"ID":"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb","Type":"ContainerStarted","Data":"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1"} Jul 09 04:25:21.877776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.877726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" event={"ID":"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb","Type":"ContainerStarted","Data":"e8efa8d4f216bf5b33e506b4435e964e8147848ddda47205bedb7e47d6d79549"} Jul 09 04:25:21.897440 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:21.897390 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" podStartSLOduration=1.897377084 podStartE2EDuration="1.897377084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:25:21.896191623 +0000 UTC m=+1519.272022699" watchObservedRunningTime="2026-07-09 04:25:21.897377084 +0000 UTC m=+1519.273208147" Jul 09 04:25:22.135218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.135123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:22.277807 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.277769 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:22.376701 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.376651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:22.789513 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.789478 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:22.794471 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.794445 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:22.882802 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.882772 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:22.883636 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:22.883619 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:23.776090 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:23.776038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:26.088797 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.088758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:26.270455 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.270417 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:26.270643 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.270601 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" podUID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" containerName="istio-proxy" containerID="cri-o://afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1" gracePeriod=30 Jul 09 04:25:26.294397 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.294360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:26.404375 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.404291 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:26.459439 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:26.459391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:27.883555 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:27.883519 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:31.516937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.516912 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:31.650778 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650737 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650795 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650867 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650917 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651000 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650950 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.650988 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651053 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651079 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:31.651218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651180 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:31.651430 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651223 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t24v5\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651430 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651282 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:31.651430 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651327 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:31.651430 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651367 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert\") pod \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\" (UID: \"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb\") " Jul 09 04:25:31.651753 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651719 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.652022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651741 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:25:31.652022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.651996 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.652022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.652014 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.652174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.652028 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.653229 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.653211 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:25:31.653663 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.653622 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:31.653804 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.653771 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5" (OuterVolumeSpecName: "kube-api-access-t24v5") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "kube-api-access-t24v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:25:31.653804 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.653769 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" (UID: "9b227c4d-e0f2-4c81-8861-9a76b1adf8eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:25:31.752427 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.752389 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.752427 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.752417 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t24v5\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-kube-api-access-t24v5\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.752427 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.752429 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.752654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.752444 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.752654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.752458 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:25:31.927020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.926933 2563 generic.go:356] "Generic (PLEG): container finished" podID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" containerID="afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1" exitCode=0 Jul 09 04:25:31.927020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.926979 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" Jul 09 04:25:31.927196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.927025 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" event={"ID":"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb","Type":"ContainerDied","Data":"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1"} Jul 09 04:25:31.927196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.927085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z" event={"ID":"9b227c4d-e0f2-4c81-8861-9a76b1adf8eb","Type":"ContainerDied","Data":"e8efa8d4f216bf5b33e506b4435e964e8147848ddda47205bedb7e47d6d79549"} Jul 09 04:25:31.927196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.927110 2563 scope.go:117] "RemoveContainer" containerID="afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1" Jul 09 04:25:31.936317 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.936298 2563 scope.go:117] "RemoveContainer" containerID="afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1" Jul 09 04:25:31.936579 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:25:31.936561 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1\": container with ID starting with afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1 not found: ID does not exist" containerID="afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1" Jul 09 04:25:31.936647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.936586 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1"} err="failed to get container status \"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1\": rpc error: code = NotFound desc = could not find container \"afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1\": container with ID starting with afdf233f6575861a222d7a7c4867863b1abf5bc9837ea7475d0eccbcfc7310e1 not found: ID does not exist" Jul 09 04:25:31.948270 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.948247 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:31.951638 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:31.951619 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-aeb5be87-openshift-default-f6545b787-plv2z"] Jul 09 04:25:32.170927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:32.170892 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:32.238532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:32.238451 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:32.660957 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:32.660920 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:32.762111 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:32.762077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:32.861168 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:32.861138 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:33.133737 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:33.133707 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" path="/var/lib/kubelet/pods/9b227c4d-e0f2-4c81-8861-9a76b1adf8eb/volumes" Jul 09 04:25:34.280229 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:34.280190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.133307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.133269 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.198818 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.198773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.284465 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.284428 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.381988 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.381932 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.487557 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.487435 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:25:40.859057 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:25:40.859020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:06.845468 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:06.845430 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:12.494664 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:12.494628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:12.555548 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:12.555513 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:12.659586 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:12.659534 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:12.788138 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:12.788105 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:21.743948 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:21.743911 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:28.635778 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:28.635739 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:34.357166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:34.357121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:34.461113 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:34.461077 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:34.557099 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:34.557063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:45.102462 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:45.102422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:45.912963 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:45.912931 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:51.551706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:51.551663 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:51.654020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:51.653975 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:51.753502 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:51.753455 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:51.853901 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:51.853785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:52.653325 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:52.653273 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:52.748667 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:52.748625 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:52.853725 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:52.853694 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:26:54.606224 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:26:54.606143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:00.340958 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:00.340922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:00.442093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:00.442055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:01.029874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:01.029796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.146396 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.146359 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.246228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.246177 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.376598 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.376556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.677151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.677121 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:07.677485 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.677473 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" containerName="istio-proxy" Jul 09 04:27:07.677571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.677487 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" containerName="istio-proxy" Jul 09 04:27:07.677571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.677545 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b227c4d-e0f2-4c81-8861-9a76b1adf8eb" containerName="istio-proxy" Jul 09 04:27:07.677571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.677554 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97dce82-dcd4-4445-86aa-1e1341ea8d70" containerName="istio-proxy" Jul 09 04:27:07.680309 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.680293 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.684081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.684061 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3c4e5fa4-openshift-default-dockercfg-ps22k\"" Jul 09 04:27:07.705524 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.705499 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:07.708281 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.708543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkkh\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708636 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708692 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708692 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708656 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708692 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708853 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708853 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708853 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.708853 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.708801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.804136 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.804095 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:07.809333 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkkh\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809886 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809715 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809886 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.809886 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.809852 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.810130 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.810113 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.810567 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.810542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.811975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.811954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.812141 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.812120 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.824428 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.824397 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.824615 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.824592 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkkh\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh\") pod \"e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:07.990033 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:07.989933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:08.136921 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.136894 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:08.139235 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:27:08.139209 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028f742e_08f4_47ab_a2ca_5a063106d4c4.slice/crio-4523143525b19fe37d610a03ed2de7b5704bdd90303599e3dde098c557ba24aa WatchSource:0}: Error finding container 4523143525b19fe37d610a03ed2de7b5704bdd90303599e3dde098c557ba24aa: Status 404 returned error can't find the container with id 4523143525b19fe37d610a03ed2de7b5704bdd90303599e3dde098c557ba24aa Jul 09 04:27:08.141389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.141352 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:08.141488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.141420 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:08.141488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.141451 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:08.376464 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.376425 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerStarted","Data":"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea"} Jul 09 04:27:08.376983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.376508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerStarted","Data":"4523143525b19fe37d610a03ed2de7b5704bdd90303599e3dde098c557ba24aa"} Jul 09 04:27:08.408341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.408277 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" podStartSLOduration=1.408256141 podStartE2EDuration="1.408256141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:27:08.407088133 +0000 UTC m=+1625.782919195" watchObservedRunningTime="2026-07-09 04:27:08.408256141 +0000 UTC m=+1625.784087210" Jul 09 04:27:08.990390 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:08.990341 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:09.995358 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:09.995326 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:10.385627 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:10.385597 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:10.386697 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:10.386674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:10.595348 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:10.595307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:10.672443 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:10.672348 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:10.770548 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:10.770510 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:11.230738 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:11.230697 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:11.332045 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:11.331997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:11.480566 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:11.480530 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:15.129249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:15.129204 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:15.836344 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:15.836305 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:15.936963 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:15.936921 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:16.283265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:16.283238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:22.046407 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:22.046365 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:22.109685 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:22.109648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:22.448859 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:22.448756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:22.808909 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:22.808869 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:22.908867 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:22.908819 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:24.452693 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.452658 2563 generic.go:356] "Generic (PLEG): container finished" podID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerID="0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea" exitCode=0 Jul 09 04:27:24.453136 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.452718 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerDied","Data":"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea"} Jul 09 04:27:24.453136 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.453115 2563 scope.go:117] "RemoveContainer" containerID="0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea" Jul 09 04:27:24.454132 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.454096 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:24.454237 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.454161 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:24.454237 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:24.454191 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:25.386621 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:25.386572 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:25.461545 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:25.461510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerStarted","Data":"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f"} Jul 09 04:27:25.990444 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:25.990371 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:25.991691 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:25.991339 2563 patch_prober.go:28] interesting pod/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 04:27:25.991691 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:25.991403 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 04:27:26.991661 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:26.991617 2563 patch_prober.go:28] interesting pod/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 04:27:26.992149 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:26.991683 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 04:27:27.990534 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:27.990483 2563 patch_prober.go:28] interesting pod/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body= Jul 09 04:27:27.990741 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:27.990560 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" Jul 09 04:27:28.581472 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:28.581427 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:28.682034 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:28.681982 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:28.843188 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:28.843098 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:28.843362 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:28.843336 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" containerID="cri-o://f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f" gracePeriod=30 Jul 09 04:27:28.864612 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:28.864577 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:29.226775 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:29.226672 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:29.316174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:29.316136 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:29.438854 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:29.438773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:34.700374 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.700346 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:34.885583 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885538 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.885583 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885578 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.885812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885604 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phkkh\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.885812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885627 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.885812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885651 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.885812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885751 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.886059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885857 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.886059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885880 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.886059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885917 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:27:34.886059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.885930 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy\") pod \"028f742e-08f4-47ab-a2ca-5a063106d4c4\" (UID: \"028f742e-08f4-47ab-a2ca-5a063106d4c4\") " Jul 09 04:27:34.886257 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886093 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:27:34.886257 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886187 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:27:34.886404 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886312 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:27:34.886452 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886433 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.886488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886451 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.886488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886466 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.886488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.886481 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028f742e-08f4-47ab-a2ca-5a063106d4c4-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.887249 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.887218 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:27:34.888165 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.888124 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:27:34.888257 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.888169 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:27:34.888257 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.888235 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:27:34.888430 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.888259 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh" (OuterVolumeSpecName: "kube-api-access-phkkh") pod "028f742e-08f4-47ab-a2ca-5a063106d4c4" (UID: "028f742e-08f4-47ab-a2ca-5a063106d4c4"). InnerVolumeSpecName "kube-api-access-phkkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:27:34.987774 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.987732 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.987774 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.987764 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.987774 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.987773 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.987774 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.987781 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phkkh\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-kube-api-access-phkkh\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:34.988058 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:34.987790 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028f742e-08f4-47ab-a2ca-5a063106d4c4-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:27:35.128492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.128449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:35.248897 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.248856 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:35.330398 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.330357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:35.490964 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.490868 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:35.509002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.508973 2563 generic.go:356] "Generic (PLEG): container finished" podID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerID="f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f" exitCode=0 Jul 09 04:27:35.509166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.509026 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" Jul 09 04:27:35.509166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.509055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerDied","Data":"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f"} Jul 09 04:27:35.509166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.509116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml" event={"ID":"028f742e-08f4-47ab-a2ca-5a063106d4c4","Type":"ContainerDied","Data":"4523143525b19fe37d610a03ed2de7b5704bdd90303599e3dde098c557ba24aa"} Jul 09 04:27:35.509166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.509148 2563 scope.go:117] "RemoveContainer" containerID="f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f" Jul 09 04:27:35.517701 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.517680 2563 scope.go:117] "RemoveContainer" containerID="0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea" Jul 09 04:27:35.525809 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.525790 2563 scope.go:117] "RemoveContainer" containerID="f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f" Jul 09 04:27:35.526051 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:27:35.526033 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f\": container with ID starting with f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f not found: ID does not exist" containerID="f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f" Jul 09 04:27:35.526095 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.526060 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f"} err="failed to get container status \"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f\": rpc error: code = NotFound desc = could not find container \"f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f\": container with ID starting with f8b404a4c4d0cf6e5548c77f350e9049d7c1306ea10dd568125fa2508f421a5f not found: ID does not exist" Jul 09 04:27:35.526095 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.526076 2563 scope.go:117] "RemoveContainer" containerID="0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea" Jul 09 04:27:35.526324 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:27:35.526306 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea\": container with ID starting with 0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea not found: ID does not exist" containerID="0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea" Jul 09 04:27:35.526364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.526331 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea"} err="failed to get container status \"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea\": rpc error: code = NotFound desc = could not find container \"0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea\": container with ID starting with 0c47d8f4addf7b0407baf161ec4221e7b9df5eeeae4e90f0c2cede200059b5ea not found: ID does not exist" Jul 09 04:27:35.532351 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.532326 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:35.542784 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:35.542758 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3c4e5fa4-openshift-default-7bbb869767-d6cml"] Jul 09 04:27:37.133369 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:37.133334 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" path="/var/lib/kubelet/pods/028f742e-08f4-47ab-a2ca-5a063106d4c4/volumes" Jul 09 04:27:41.012654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:41.012617 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:41.070597 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:41.070555 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:47.935726 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:47.935685 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:48.230670 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.230569 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:27:48.231020 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231003 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.231081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231022 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.231081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231033 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.231081 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231039 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.231176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231095 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.231176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.231108 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="028f742e-08f4-47ab-a2ca-5a063106d4c4" containerName="istio-proxy" Jul 09 04:27:48.235421 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.235396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.240173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.240149 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-11e0a3fa-openshift-default-dockercfg-std6p\"" Jul 09 04:27:48.250389 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.250366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:27:48.256761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.256728 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:48.305209 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305226 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305354 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27s4z\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305613 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.305613 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.305483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.405892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.405861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.405907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.405931 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406093 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406313 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406102 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27s4z\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406313 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406313 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406313 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406517 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406517 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406632 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406632 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.406984 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.406963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.408460 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.408433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.408582 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.408564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.414816 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.414788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.415410 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.415376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27s4z\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z\") pod \"e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.530394 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.530299 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:48.545911 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.545881 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:48.686279 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.686198 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:27:48.688567 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:27:48.688537 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07e32947_4756_42ca_97e9_2979ee141259.slice/crio-5f39dd90ffa716bb13260597baeb1d1a33f14bac236b916d5a383ef26c424d5c WatchSource:0}: Error finding container 5f39dd90ffa716bb13260597baeb1d1a33f14bac236b916d5a383ef26c424d5c: Status 404 returned error can't find the container with id 5f39dd90ffa716bb13260597baeb1d1a33f14bac236b916d5a383ef26c424d5c Jul 09 04:27:48.690706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.690675 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:48.690792 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.690741 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:48.690792 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:48.690770 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:27:49.573815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:49.573777 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerStarted","Data":"95d33fcf6c6e8b6dcdea51327198b607496d4033dc1c32b677b09db2df7cde7b"} Jul 09 04:27:49.574265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:49.573854 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerStarted","Data":"5f39dd90ffa716bb13260597baeb1d1a33f14bac236b916d5a383ef26c424d5c"} Jul 09 04:27:50.546529 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:50.546488 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:50.551445 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:50.551413 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:50.572264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:50.572204 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podStartSLOduration=2.572183623 podStartE2EDuration="2.572183623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:27:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:27:49.593077571 +0000 UTC m=+1666.968908634" watchObservedRunningTime="2026-07-09 04:27:50.572183623 +0000 UTC m=+1667.948014687" Jul 09 04:27:50.578047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:50.578015 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:50.579022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:50.579006 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:27:51.509166 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:51.509120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:51.582598 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:51.582560 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:51.649345 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:51.649296 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:52.040746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:52.040709 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:52.142575 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:52.142539 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:52.240838 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:52.240796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:56.029107 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:56.029070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:58.848519 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:58.848483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:27:58.947471 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:27:58.947429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:03.650790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.650700 2563 generic.go:356] "Generic (PLEG): container finished" podID="07e32947-4756-42ca-97e9-2979ee141259" containerID="95d33fcf6c6e8b6dcdea51327198b607496d4033dc1c32b677b09db2df7cde7b" exitCode=0 Jul 09 04:28:03.650790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.650773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerDied","Data":"95d33fcf6c6e8b6dcdea51327198b607496d4033dc1c32b677b09db2df7cde7b"} Jul 09 04:28:03.651228 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.651201 2563 scope.go:117] "RemoveContainer" containerID="95d33fcf6c6e8b6dcdea51327198b607496d4033dc1c32b677b09db2df7cde7b" Jul 09 04:28:03.652256 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.652230 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:28:03.652341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.652296 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:28:03.652341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:03.652328 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:28:04.657002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:04.656969 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerStarted","Data":"d1fa530a535ba71fbddac06b4a8a24daa104ab0d9c36cddd03472782288ef07d"} Jul 09 04:28:05.546851 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:05.546784 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:28:05.547869 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:05.547819 2563 patch_prober.go:28] interesting pod/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 04:28:05.547992 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:05.547893 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 04:28:05.578094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:05.578062 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:28:06.547232 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:06.547186 2563 patch_prober.go:28] interesting pod/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 04:28:06.547638 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:06.547244 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 04:28:07.547145 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:07.547105 2563 patch_prober.go:28] interesting pod/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 04:28:07.547332 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:07.547162 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 04:28:08.546455 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:08.546418 2563 patch_prober.go:28] interesting pod/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body= Jul 09 04:28:08.546624 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:08.546484 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" Jul 09 04:28:08.954025 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:08.953931 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:09.054534 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:09.054499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:09.470176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:09.470139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:09.550962 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:09.550933 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:28:09.552078 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:09.552059 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:28:12.762306 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:12.762251 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:12.863548 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:12.863512 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:28.866652 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:28.866567 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:29.133378 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:29.133283 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:34.997845 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:34.997799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:28:40.077143 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:28:40.077087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:16.494792 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:16.494749 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:16.989222 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:16.989183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:22.597003 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:22.596965 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:22.873380 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:22.873279 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:29:22.873607 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:22.873580 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" containerID="cri-o://d1fa530a535ba71fbddac06b4a8a24daa104ab0d9c36cddd03472782288ef07d" gracePeriod=30 Jul 09 04:29:23.738332 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:23.738297 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:24.238425 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:24.238385 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:24.337038 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:24.336998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:24.432677 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:24.432640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:24.554129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:24.554092 2563 patch_prober.go:28] interesting pod/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 04:29:24.554307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:24.554155 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:29:25.239406 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:25.239343 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:25.332146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:25.332114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:25.432378 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:25.432333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:26.863742 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:26.863703 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:28.046103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.046073 2563 generic.go:356] "Generic (PLEG): container finished" podID="07e32947-4756-42ca-97e9-2979ee141259" containerID="d1fa530a535ba71fbddac06b4a8a24daa104ab0d9c36cddd03472782288ef07d" exitCode=0 Jul 09 04:29:28.046459 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.046149 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerDied","Data":"d1fa530a535ba71fbddac06b4a8a24daa104ab0d9c36cddd03472782288ef07d"} Jul 09 04:29:28.046459 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.046276 2563 scope.go:117] "RemoveContainer" containerID="95d33fcf6c6e8b6dcdea51327198b607496d4033dc1c32b677b09db2df7cde7b" Jul 09 04:29:28.121329 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.121301 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:29:28.228907 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.228809 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.228907 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.228882 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.228947 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.228974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27s4z\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229014 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229036 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229070 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229093 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229120 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs\") pod \"07e32947-4756-42ca-97e9-2979ee141259\" (UID: \"07e32947-4756-42ca-97e9-2979ee141259\") " Jul 09 04:29:28.229465 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229284 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:29:28.229465 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229361 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:29:28.229576 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229549 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:29:28.229630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229574 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.229630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229595 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07e32947-4756-42ca-97e9-2979ee141259-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.229630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.229573 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:29:28.230782 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.230757 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data" (OuterVolumeSpecName: "istio-data") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:29:28.231543 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.231520 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:29:28.231779 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.231752 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:29:28.231779 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.231774 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token" (OuterVolumeSpecName: "istio-token") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:29:28.231976 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.231796 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z" (OuterVolumeSpecName: "kube-api-access-27s4z") pod "07e32947-4756-42ca-97e9-2979ee141259" (UID: "07e32947-4756-42ca-97e9-2979ee141259"). InnerVolumeSpecName "kube-api-access-27s4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:29:28.330806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330769 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27s4z\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-kube-api-access-27s4z\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.330806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330803 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.330806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330812 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.330806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330820 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.331075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330847 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07e32947-4756-42ca-97e9-2979ee141259-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.331075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330860 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07e32947-4756-42ca-97e9-2979ee141259-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:28.331075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:28.330869 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07e32947-4756-42ca-97e9-2979ee141259-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:29:29.051571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.051537 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" Jul 09 04:29:29.051571 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.051566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv" event={"ID":"07e32947-4756-42ca-97e9-2979ee141259","Type":"ContainerDied","Data":"5f39dd90ffa716bb13260597baeb1d1a33f14bac236b916d5a383ef26c424d5c"} Jul 09 04:29:29.052114 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.051631 2563 scope.go:117] "RemoveContainer" containerID="d1fa530a535ba71fbddac06b4a8a24daa104ab0d9c36cddd03472782288ef07d" Jul 09 04:29:29.075839 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.075792 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:29:29.079333 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.079301 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-11e0a3fa-openshift-default-7bb7f9569f-6d5pv"] Jul 09 04:29:29.133377 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:29.133342 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07e32947-4756-42ca-97e9-2979ee141259" path="/var/lib/kubelet/pods/07e32947-4756-42ca-97e9-2979ee141259/volumes" Jul 09 04:29:32.635773 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:32.635737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:32.736041 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:32.736006 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:33.343012 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:33.342975 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:39.073748 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:39.073705 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:39.181129 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:39.181084 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:39.283075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:39.283034 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:49.842600 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:49.842561 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:29:50.204130 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:29:50.204044 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:01.639037 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:01.639001 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:03.179874 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:03.179845 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:30:03.184208 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:03.184185 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:30:11.208573 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:11.208520 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:16.969373 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:16.969336 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:17.034697 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.034656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:17.343224 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.343187 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:17.636486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.636401 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:30:17.636921 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.636904 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.636981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.636926 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.636981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.636940 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.636981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.636949 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.637253 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.637046 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.637253 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.637059 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="07e32947-4756-42ca-97e9-2979ee141259" containerName="istio-proxy" Jul 09 04:30:17.639872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.639853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.642368 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.642348 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7aa53b-openshift-default-dockercfg-4wfhm\"" Jul 09 04:30:17.653261 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.653235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:30:17.661259 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.661232 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:17.764271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f277k\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.764516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.764502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865277 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865277 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865274 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865449 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f277k\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865530 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865909 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.865963 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.866023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.865961 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.866082 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.866046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.866151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.866129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.867959 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.867928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.868080 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.868062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.873574 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.873547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.873667 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.873612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f277k\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k\") pod \"e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:17.949547 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:17.949452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:18.087215 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.087186 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:30:18.089310 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:30:18.089282 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de6c723_beff_408a_84b4_7d98d0d618a6.slice/crio-947fb5aae158ed3d632dd5263344d8efaed806bd436fad9a9c9fd5115c87bb72 WatchSource:0}: Error finding container 947fb5aae158ed3d632dd5263344d8efaed806bd436fad9a9c9fd5115c87bb72: Status 404 returned error can't find the container with id 947fb5aae158ed3d632dd5263344d8efaed806bd436fad9a9c9fd5115c87bb72 Jul 09 04:30:18.091243 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.091215 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:18.091306 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.091277 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:18.091348 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.091306 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:18.275296 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.275200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerStarted","Data":"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da"} Jul 09 04:30:18.275296 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.275263 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerStarted","Data":"947fb5aae158ed3d632dd5263344d8efaed806bd436fad9a9c9fd5115c87bb72"} Jul 09 04:30:18.295472 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.295410 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podStartSLOduration=1.295388236 podStartE2EDuration="1.295388236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:18.293798933 +0000 UTC m=+1815.669629996" watchObservedRunningTime="2026-07-09 04:30:18.295388236 +0000 UTC m=+1815.671219304" Jul 09 04:30:18.320610 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.320572 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:18.949948 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:18.949909 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:19.954608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:19.954577 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:20.241001 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:20.240900 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:20.285579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:20.285543 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:20.286525 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:20.286504 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:20.322930 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:20.322883 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:20.907409 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:20.907376 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:21.008152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:21.008114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:24.776960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:24.776916 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:25.125945 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.125888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:25.400104 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.400014 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:30:25.403764 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.403740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.406230 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.406210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a259cf-openshift-default-dockercfg-lwgv2\"" Jul 09 04:30:25.414786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.414762 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:30:25.426289 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.426261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:25.534161 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534316 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv62w\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534364 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.534646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.534412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.609398 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.609364 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:25.635087 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635196 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv62w\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635285 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635246 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635601 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635291 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635601 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635601 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.635815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635803 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.636022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.635955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.637559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.637534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.638257 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.638236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.643217 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.643197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv62w\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.643309 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.643290 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token\") pod \"e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.715539 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.715439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:25.858471 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.858436 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:30:25.863266 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.863224 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:25.863404 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.863372 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:25.863492 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:25.863463 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:26.314360 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:26.314322 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerStarted","Data":"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da"} Jul 09 04:30:26.314540 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:26.314374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerStarted","Data":"3bb6fd43e28b95f7884dfac4b3f3f0b47ab6abe01fbf0095183072ebb515a0f0"} Jul 09 04:30:26.335881 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:26.335804 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podStartSLOduration=1.33578561 podStartE2EDuration="1.33578561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:26.333778677 +0000 UTC m=+1823.709609741" watchObservedRunningTime="2026-07-09 04:30:26.33578561 +0000 UTC m=+1823.711616673" Jul 09 04:30:26.716346 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:26.716261 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:26.721030 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:26.721010 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:27.318957 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:27.318929 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:27.320085 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:27.320061 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:28.297786 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:28.297747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:28.398165 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:28.398132 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:28.497080 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:28.497043 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:28.597642 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:28.597550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:28.930391 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:28.930290 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:29.033342 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:29.033302 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:32.840772 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:32.840730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:36.226544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.226015 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:53894->10.133.0.32:15021: read: connection reset by peer" start-of-body= Jul 09 04:30:36.226544 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.226096 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:53894->10.133.0.32:15021: read: connection reset by peer" Jul 09 04:30:36.362867 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.362754 2563 generic.go:356] "Generic (PLEG): container finished" podID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerID="7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da" exitCode=0 Jul 09 04:30:36.363023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.362855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerDied","Data":"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da"} Jul 09 04:30:36.363282 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.363267 2563 scope.go:117] "RemoveContainer" containerID="7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da" Jul 09 04:30:36.364268 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.364241 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:36.364376 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.364325 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:36.364376 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:36.364371 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:37.368889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:37.368850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerStarted","Data":"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785"} Jul 09 04:30:37.950044 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:37.949997 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:37.950294 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:37.950266 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 09 04:30:37.950359 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:37.950334 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 09 04:30:38.950732 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:38.950691 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 09 04:30:38.951157 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:38.950765 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 09 04:30:39.950868 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:39.950758 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 09 04:30:39.950868 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:39.950818 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 09 04:30:40.950066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:40.950022 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 09 04:30:40.950259 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:40.950110 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 09 04:30:41.953911 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:41.953880 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:41.954356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:41.954247 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:41.954992 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:41.954968 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:30:42.329029 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:42.328989 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:42.430622 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:42.430589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:42.834865 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:42.834279 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": read tcp 10.133.0.2:40172->10.133.0.33:15021: read: connection reset by peer" start-of-body= Jul 09 04:30:42.834865 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:42.834349 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": read tcp 10.133.0.2:40172->10.133.0.33:15021: read: connection reset by peer" Jul 09 04:30:43.401268 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.401237 2563 generic.go:356] "Generic (PLEG): container finished" podID="90ab7b26-f876-4589-9745-ab557deb6756" containerID="701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da" exitCode=0 Jul 09 04:30:43.401654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.401302 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerDied","Data":"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da"} Jul 09 04:30:43.401745 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.401730 2563 scope.go:117] "RemoveContainer" containerID="701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da" Jul 09 04:30:43.402773 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.402749 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:43.402856 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.402810 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:43.402897 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:43.402862 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:30:44.412151 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:44.412113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerStarted","Data":"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c"} Jul 09 04:30:44.716119 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:44.716015 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:44.716282 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:44.716261 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 04:30:44.716353 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:44.716331 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 04:30:45.715991 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:45.715952 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 04:30:45.716393 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:45.716015 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 04:30:46.716282 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:46.716241 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 04:30:46.716676 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:46.716317 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 04:30:47.716260 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:47.716221 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 09 04:30:47.716473 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:47.716288 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 09 04:30:48.719624 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:48.719584 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:48.720047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:48.719870 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:48.720683 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:48.720663 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:30:50.320428 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:50.320377 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:50.422960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:50.422925 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:30:55.951379 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:30:55.951324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:19.865449 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:19.865410 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:41.709441 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:41.709341 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:42.664645 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:42.664595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:42.802191 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:42.802157 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:43.200239 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:43.200196 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:43.300054 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:43.300019 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:43.454916 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:43.454796 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:31:48.324844 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:31:48.324784 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:25.153002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:25.152960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:25.424474 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:25.424379 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:32:25.424669 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:25.424640 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" containerID="cri-o://75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785" gracePeriod=30 Jul 09 04:32:25.439481 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:25.439406 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:25.853491 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:25.853450 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:26.246019 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:26.245918 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:26.346155 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:26.346120 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:26.470158 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:26.470123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:26.957104 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:26.957070 2563 patch_prober.go:28] interesting pod/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 04:32:26.957271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:26.957145 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:32:30.676452 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.676427 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:32:30.814272 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814230 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814289 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814320 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814349 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f277k\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814373 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814457 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814400 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814458 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814504 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814552 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy\") pod \"3de6c723-beff-408a-84b4-7d98d0d618a6\" (UID: \"3de6c723-beff-408a-84b4-7d98d0d618a6\") " Jul 09 04:32:30.814708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814575 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:30.814950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814760 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:30.814950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814876 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:32:30.814950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814893 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.814950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.814913 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.815147 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.815102 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:30.815420 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.815386 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:30.816816 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.816795 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:32:30.817009 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.816988 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:30.817196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.817166 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k" (OuterVolumeSpecName: "kube-api-access-f277k") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "kube-api-access-f277k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:32:30.817196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.817175 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3de6c723-beff-408a-84b4-7d98d0d618a6" (UID: "3de6c723-beff-408a-84b4-7d98d0d618a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:32:30.911369 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.911332 2563 generic.go:356] "Generic (PLEG): container finished" podID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerID="75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785" exitCode=0 Jul 09 04:32:30.911532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.911383 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" Jul 09 04:32:30.911532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.911414 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerDied","Data":"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785"} Jul 09 04:32:30.911532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.911476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb" event={"ID":"3de6c723-beff-408a-84b4-7d98d0d618a6","Type":"ContainerDied","Data":"947fb5aae158ed3d632dd5263344d8efaed806bd436fad9a9c9fd5115c87bb72"} Jul 09 04:32:30.911532 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.911507 2563 scope.go:117] "RemoveContainer" containerID="75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785" Jul 09 04:32:30.915450 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915426 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915454 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915470 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f277k\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-kube-api-access-f277k\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915486 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3de6c723-beff-408a-84b4-7d98d0d618a6-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915500 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915514 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.915562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.915528 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3de6c723-beff-408a-84b4-7d98d0d618a6-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:30.921133 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.921110 2563 scope.go:117] "RemoveContainer" containerID="7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da" Jul 09 04:32:30.929055 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.929039 2563 scope.go:117] "RemoveContainer" containerID="75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785" Jul 09 04:32:30.929297 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:32:30.929275 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785\": container with ID starting with 75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785 not found: ID does not exist" containerID="75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785" Jul 09 04:32:30.929361 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.929305 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785"} err="failed to get container status \"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785\": rpc error: code = NotFound desc = could not find container \"75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785\": container with ID starting with 75be313b3dde9ff63a9480e72d6a077d01a01217d3caff83e0f5f11c26f2b785 not found: ID does not exist" Jul 09 04:32:30.929361 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.929322 2563 scope.go:117] "RemoveContainer" containerID="7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da" Jul 09 04:32:30.929559 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:32:30.929544 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da\": container with ID starting with 7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da not found: ID does not exist" containerID="7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da" Jul 09 04:32:30.929604 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.929561 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da"} err="failed to get container status \"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da\": rpc error: code = NotFound desc = could not find container \"7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da\": container with ID starting with 7d8bc6b97080b3b3173c11d5b3a086d4462fb13924e286eb27edd985d84fb8da not found: ID does not exist" Jul 09 04:32:30.935477 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.935358 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:32:30.937170 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:30.937145 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7aa53b-openshift-default-74676b697f-86cfb"] Jul 09 04:32:31.133924 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:31.133840 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" path="/var/lib/kubelet/pods/3de6c723-beff-408a-84b4-7d98d0d618a6/volumes" Jul 09 04:32:32.336361 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:32.336327 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:32.474921 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:32.474882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:32.578057 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:32.578026 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:32:32.578315 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:32.578291 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" containerID="cri-o://893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c" gracePeriod=30 Jul 09 04:32:32.594877 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:32.594763 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:33.189812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.189773 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:33.487004 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.486930 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:32:33.487341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487283 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.487341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487296 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.487341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487311 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.487341 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487316 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.487470 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487376 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.487470 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.487384 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de6c723-beff-408a-84b4-7d98d0d618a6" containerName="istio-proxy" Jul 09 04:32:33.490564 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.490545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.493337 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.493312 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ed5c7e-openshift-default-dockercfg-9bbft\"" Jul 09 04:32:33.508779 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.508751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:32:33.519136 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.519102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:33.643669 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.643669 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.643969 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.643969 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.643969 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.643969 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.644171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.643992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.644171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.644057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvdln\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.644171 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.644137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.722102 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.722055 2563 patch_prober.go:28] interesting pod/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 04:32:33.722245 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.722124 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 04:32:33.745264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745208 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745307 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.745501 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.745432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvdln\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.746059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.746011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.746199 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.746071 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.746336 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.746291 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.746449 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.746422 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.746494 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.746452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.747975 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.747954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.748276 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.748253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.753711 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.753689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.753855 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.753812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvdln\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln\") pod \"e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.775205 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.775167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:33.801175 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.801148 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:33.944174 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.944147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:32:33.946174 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:32:33.946142 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee6b1468_b10e_4a95_a47e_9339c1b96709.slice/crio-fcd19307909c54671792f6ee66753eb075fb5b711b5698fb014e9cc732b23ff5 WatchSource:0}: Error finding container fcd19307909c54671792f6ee66753eb075fb5b711b5698fb014e9cc732b23ff5: Status 404 returned error can't find the container with id fcd19307909c54671792f6ee66753eb075fb5b711b5698fb014e9cc732b23ff5 Jul 09 04:32:33.948412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.948382 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:33.948481 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.948451 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:33.948516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:33.948481 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:34.932870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:34.932808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerStarted","Data":"9c0241c82cdfadf091e4dd866a4dfef5b44d2c31e9df23b1b4eead8beb149edc"} Jul 09 04:32:34.933278 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:34.932883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerStarted","Data":"fcd19307909c54671792f6ee66753eb075fb5b711b5698fb014e9cc732b23ff5"} Jul 09 04:32:34.955022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:34.954968 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podStartSLOduration=1.954947487 podStartE2EDuration="1.954947487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:34.952858144 +0000 UTC m=+1952.328689203" watchObservedRunningTime="2026-07-09 04:32:34.954947487 +0000 UTC m=+1952.330778550" Jul 09 04:32:35.801919 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:35.801879 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:35.806956 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:35.806931 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:35.937896 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:35.937860 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:35.939141 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:35.939118 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:36.876268 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:36.876224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:36.962997 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:36.962961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:37.025214 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.025171 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:37.216387 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.216294 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:37.396782 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.396740 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:37.496736 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.496627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:37.826252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.826226 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:32:37.948481 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.948444 2563 generic.go:356] "Generic (PLEG): container finished" podID="90ab7b26-f876-4589-9745-ab557deb6756" containerID="893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c" exitCode=0 Jul 09 04:32:37.948662 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.948500 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" Jul 09 04:32:37.948662 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.948531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerDied","Data":"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c"} Jul 09 04:32:37.948662 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.948623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7" event={"ID":"90ab7b26-f876-4589-9745-ab557deb6756","Type":"ContainerDied","Data":"3bb6fd43e28b95f7884dfac4b3f3f0b47ab6abe01fbf0095183072ebb515a0f0"} Jul 09 04:32:37.948662 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.948649 2563 scope.go:117] "RemoveContainer" containerID="893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c" Jul 09 04:32:37.956888 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.956870 2563 scope.go:117] "RemoveContainer" containerID="701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da" Jul 09 04:32:37.964576 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.964559 2563 scope.go:117] "RemoveContainer" containerID="893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c" Jul 09 04:32:37.964870 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:32:37.964788 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c\": container with ID starting with 893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c not found: ID does not exist" containerID="893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c" Jul 09 04:32:37.964870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.964811 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c"} err="failed to get container status \"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c\": rpc error: code = NotFound desc = could not find container \"893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c\": container with ID starting with 893e2de27c59672e3a49e2f439773e1ddb21f217121438447107e2ae0312887c not found: ID does not exist" Jul 09 04:32:37.964870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.964846 2563 scope.go:117] "RemoveContainer" containerID="701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da" Jul 09 04:32:37.965052 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:32:37.965036 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da\": container with ID starting with 701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da not found: ID does not exist" containerID="701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da" Jul 09 04:32:37.965091 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.965056 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da"} err="failed to get container status \"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da\": rpc error: code = NotFound desc = could not find container \"701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da\": container with ID starting with 701ad342eb2f16cb4bbb6ab45d3d02a4b911c4a5b944b6a9d23fc7cab8c238da not found: ID does not exist" Jul 09 04:32:37.984040 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984012 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984192 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984068 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984256 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984188 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984256 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984236 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984283 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984352 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984374 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:37.984412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984386 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984432 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984468 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv62w\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w\") pod \"90ab7b26-f876-4589-9745-ab557deb6756\" (UID: \"90ab7b26-f876-4589-9745-ab557deb6756\") " Jul 09 04:32:37.984656 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984629 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:32:37.984976 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984921 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:37.984976 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984937 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:37.984976 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.984969 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90ab7b26-f876-4589-9745-ab557deb6756-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:37.985428 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.985306 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data" (OuterVolumeSpecName: "istio-data") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:37.985608 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.985545 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:37.986618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.986590 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:32:37.986770 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.986751 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:32:37.986942 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.986925 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token" (OuterVolumeSpecName: "istio-token") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:32:37.987331 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:37.987315 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w" (OuterVolumeSpecName: "kube-api-access-zv62w") pod "90ab7b26-f876-4589-9745-ab557deb6756" (UID: "90ab7b26-f876-4589-9745-ab557deb6756"). InnerVolumeSpecName "kube-api-access-zv62w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:32:38.085451 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085414 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085451 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085442 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90ab7b26-f876-4589-9745-ab557deb6756-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085451 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085455 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085468 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085481 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085493 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90ab7b26-f876-4589-9745-ab557deb6756-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.085746 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.085506 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv62w\" (UniqueName: \"kubernetes.io/projected/90ab7b26-f876-4589-9745-ab557deb6756-kube-api-access-zv62w\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:32:38.270283 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.270247 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:32:38.274702 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:38.274670 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a259cf-openshift-default-64b7d6c455-d96z7"] Jul 09 04:32:39.134360 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:39.134326 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90ab7b26-f876-4589-9745-ab557deb6756" path="/var/lib/kubelet/pods/90ab7b26-f876-4589-9745-ab557deb6756/volumes" Jul 09 04:32:41.425058 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:41.425016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:41.896223 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:41.896188 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:42.183363 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183277 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:32:42.183704 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183685 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.183704 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183705 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.183902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183715 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.183902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183721 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.183902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183789 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.183902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.183797 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ab7b26-f876-4589-9745-ab557deb6756" containerName="istio-proxy" Jul 09 04:32:42.186738 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.186720 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.189577 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.189556 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a54d19-openshift-default-dockercfg-s248p\"" Jul 09 04:32:42.198587 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.198560 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:32:42.213049 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.213012 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:42.222690 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.222641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg92g\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.222906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.222699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.222906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.222808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.222906 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.222884 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.223066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.222968 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.223066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.223020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.223066 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.223049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.223189 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.223073 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.223189 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.223096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323455 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323455 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg92g\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323556 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.323727 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323707 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.323760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.324009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324047 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.324031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324326 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.324306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324400 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.324360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.324440 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.324403 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.325983 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.325910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.326264 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.326244 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.332587 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.332563 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.332692 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.332668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg92g\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g\") pod \"e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.468398 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.468278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:42.497866 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.497478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:42.669552 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.669485 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:32:42.671947 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:32:42.671921 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9503e1_66bf_48c9_abb0_c31130180511.slice/crio-a080a3a7bfc45977a0c8645f18170a59cc8d25d68c54e62f931fb7d23b368def WatchSource:0}: Error finding container a080a3a7bfc45977a0c8645f18170a59cc8d25d68c54e62f931fb7d23b368def: Status 404 returned error can't find the container with id a080a3a7bfc45977a0c8645f18170a59cc8d25d68c54e62f931fb7d23b368def Jul 09 04:32:42.674175 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.674141 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:42.674253 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.674212 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:42.674253 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.674249 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:42.976882 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.976783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerStarted","Data":"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4"} Jul 09 04:32:42.976882 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.976848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerStarted","Data":"a080a3a7bfc45977a0c8645f18170a59cc8d25d68c54e62f931fb7d23b368def"} Jul 09 04:32:42.998176 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:42.998105 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podStartSLOduration=0.998081905 podStartE2EDuration="998.081905ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:32:42.996056711 +0000 UTC m=+1960.371887776" watchObservedRunningTime="2026-07-09 04:32:42.998081905 +0000 UTC m=+1960.373912973" Jul 09 04:32:43.498873 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:43.498809 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:43.513072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:43.512798 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:43.981799 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:43.981770 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:43.982879 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:43.982862 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:32:44.921853 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:44.921793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:45.013370 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:45.013261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:45.084153 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:45.084124 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:45.184861 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:45.184727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:45.460353 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:45.460257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:45.559761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:45.559729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:49.460206 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:49.460166 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:50.014896 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.014861 2563 generic.go:356] "Generic (PLEG): container finished" podID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerID="9c0241c82cdfadf091e4dd866a4dfef5b44d2c31e9df23b1b4eead8beb149edc" exitCode=0 Jul 09 04:32:50.015077 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.014931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerDied","Data":"9c0241c82cdfadf091e4dd866a4dfef5b44d2c31e9df23b1b4eead8beb149edc"} Jul 09 04:32:50.015307 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.015294 2563 scope.go:117] "RemoveContainer" containerID="9c0241c82cdfadf091e4dd866a4dfef5b44d2c31e9df23b1b4eead8beb149edc" Jul 09 04:32:50.016292 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.016268 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:50.016348 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.016334 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:50.016391 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.016365 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:32:50.938646 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:50.938598 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:51.021437 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:51.021395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerStarted","Data":"faa1aa18403a0aaaa84752e4840cb1612b32399a4d769e0f1f140db78ee19728"} Jul 09 04:32:51.801639 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:51.801260 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:51.802914 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:51.802876 2563 patch_prober.go:28] interesting pod/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 04:32:51.803074 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:51.802939 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 04:32:52.801815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:52.801773 2563 patch_prober.go:28] interesting pod/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 04:32:52.813929 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:52.813866 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 04:32:53.802356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:53.802313 2563 patch_prober.go:28] interesting pod/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 04:32:53.803022 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:53.802986 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 04:32:54.801871 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:54.801802 2563 patch_prober.go:28] interesting pod/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 09 04:32:54.802094 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:54.801913 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 09 04:32:55.811690 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:55.811624 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:55.812204 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:55.812177 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:55.813238 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:55.813212 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:32:57.658347 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:57.658307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:58.039470 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:58.039429 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:58.138324 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:58.138288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:58.284330 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:58.284288 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:59.484007 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:59.483972 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:32:59.585225 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:32:59.585181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:03.080245 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.080212 2563 generic.go:356] "Generic (PLEG): container finished" podID="0d9503e1-66bf-48c9-abb0-c31130180511" containerID="7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4" exitCode=0 Jul 09 04:33:03.080665 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.080280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerDied","Data":"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4"} Jul 09 04:33:03.080714 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.080694 2563 scope.go:117] "RemoveContainer" containerID="7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4" Jul 09 04:33:03.081679 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.081654 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:03.081771 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.081723 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:03.081771 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.081752 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:03.642115 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.642074 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:03.713006 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.712967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:03.950132 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.950046 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:33:03.950331 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.950304 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" containerID="cri-o://faa1aa18403a0aaaa84752e4840cb1612b32399a4d769e0f1f140db78ee19728" gracePeriod=30 Jul 09 04:33:03.994951 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:03.994912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:04.086311 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.086279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerStarted","Data":"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489"} Jul 09 04:33:04.318065 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.318028 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:04.498866 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.498814 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:04.499141 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.499106 2563 patch_prober.go:28] interesting pod/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 04:33:04.499244 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.499161 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 04:33:04.829291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.829255 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:04.927105 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:04.927067 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:05.112773 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:05.112672 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:05.167962 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:05.167929 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:05.498618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:05.498509 2563 patch_prober.go:28] interesting pod/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 04:33:05.498618 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:05.498583 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 04:33:06.498625 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:06.498572 2563 patch_prober.go:28] interesting pod/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 04:33:06.499160 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:06.498667 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 04:33:07.499330 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:07.499286 2563 patch_prober.go:28] interesting pod/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 04:33:07.499871 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:07.499363 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 04:33:08.498738 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:08.498687 2563 patch_prober.go:28] interesting pod/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 09 04:33:08.498960 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:08.498794 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 09 04:33:09.126031 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.125994 2563 generic.go:356] "Generic (PLEG): container finished" podID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerID="faa1aa18403a0aaaa84752e4840cb1612b32399a4d769e0f1f140db78ee19728" exitCode=0 Jul 09 04:33:09.126412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.126055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerDied","Data":"faa1aa18403a0aaaa84752e4840cb1612b32399a4d769e0f1f140db78ee19728"} Jul 09 04:33:09.126412 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.126158 2563 scope.go:117] "RemoveContainer" containerID="9c0241c82cdfadf091e4dd866a4dfef5b44d2c31e9df23b1b4eead8beb149edc" Jul 09 04:33:09.215519 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.215452 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:33:09.271834 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.271789 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.271849 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.271890 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.271917 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.271974 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272027 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272002 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272054 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvdln\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272083 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272109 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo\") pod \"ee6b1468-b10e-4a95-a47e-9339c1b96709\" (UID: \"ee6b1468-b10e-4a95-a47e-9339c1b96709\") " Jul 09 04:33:09.272303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272218 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:09.272303 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272250 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:09.272540 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272443 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:09.272614 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272591 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.272669 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272623 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.272669 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272640 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.272869 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272810 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:33:09.272971 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.272948 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:09.274284 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.274260 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:09.274423 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.274406 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:33:09.274498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.274470 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:09.274924 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.274897 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln" (OuterVolumeSpecName: "kube-api-access-tvdln") pod "ee6b1468-b10e-4a95-a47e-9339c1b96709" (UID: "ee6b1468-b10e-4a95-a47e-9339c1b96709"). InnerVolumeSpecName "kube-api-access-tvdln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:09.373846 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373799 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee6b1468-b10e-4a95-a47e-9339c1b96709-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.374023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373861 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvdln\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-kube-api-access-tvdln\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.374023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373875 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.374023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373888 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.374023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373898 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.374023 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.373908 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee6b1468-b10e-4a95-a47e-9339c1b96709-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:09.502354 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.502271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:09.502729 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.502699 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:09.503488 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:09.503472 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:10.131886 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.131855 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" Jul 09 04:33:10.132320 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.131883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb" event={"ID":"ee6b1468-b10e-4a95-a47e-9339c1b96709","Type":"ContainerDied","Data":"fcd19307909c54671792f6ee66753eb075fb5b711b5698fb014e9cc732b23ff5"} Jul 09 04:33:10.132320 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.131944 2563 scope.go:117] "RemoveContainer" containerID="faa1aa18403a0aaaa84752e4840cb1612b32399a4d769e0f1f140db78ee19728" Jul 09 04:33:10.156300 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.156271 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:33:10.162032 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.162004 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ed5c7e-openshift-default-6bf984784f-gpzzb"] Jul 09 04:33:10.636774 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.636738 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:10.698634 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.698595 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:10.888572 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.888476 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:33:10.909212 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:10.909177 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:11.134372 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.134336 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" path="/var/lib/kubelet/pods/ee6b1468-b10e-4a95-a47e-9339c1b96709/volumes" Jul 09 04:33:11.137518 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.137495 2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" secret="" err="secret \"e2e-api-b-a54d19-openshift-default-dockercfg-s248p\" not found" Jul 09 04:33:11.490198 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.490152 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:11.766060 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.765964 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:33:11.766394 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.766376 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:11.766475 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.766397 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:11.766546 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.766533 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:11.766600 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.766553 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:11.769813 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.769789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.772507 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.772488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-48a065-openshift-default-dockercfg-z6bsr\"" Jul 09 04:33:11.781382 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.781358 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:33:11.793088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.793056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:11.895668 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895668 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjpw4\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895920 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.895937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.895937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.988218 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.988186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:11.997425 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997464 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997606 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997895 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997637 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjpw4\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997895 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.997895 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.997693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.998107 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.998067 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.998232 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.998140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.998297 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.998243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.998356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.998304 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:11.998356 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:11.998321 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.000158 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.000133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.000450 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.000428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.011761 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.011739 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.011902 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.011883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjpw4\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4\") pod \"e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.080288 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.080257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:12.144462 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.144322 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" containerID="cri-o://fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489" gracePeriod=30 Jul 09 04:33:12.218534 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.218508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:33:12.220503 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:33:12.220478 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ebcd80_b2c7_45fa_96bd_7363c5151ba2.slice/crio-e9f1a972bee1cb44dfb6324e9708403038d597e5de262666aa99e66483dca061 WatchSource:0}: Error finding container e9f1a972bee1cb44dfb6324e9708403038d597e5de262666aa99e66483dca061: Status 404 returned error can't find the container with id e9f1a972bee1cb44dfb6324e9708403038d597e5de262666aa99e66483dca061 Jul 09 04:33:12.222665 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.222635 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:12.222734 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.222703 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:12.222780 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:12.222733 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:13.149509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:13.149476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerStarted","Data":"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7"} Jul 09 04:33:13.149916 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:13.149525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerStarted","Data":"e9f1a972bee1cb44dfb6324e9708403038d597e5de262666aa99e66483dca061"} Jul 09 04:33:13.170711 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:13.170652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podStartSLOduration=2.170632183 podStartE2EDuration="2.170632183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:13.170252555 +0000 UTC m=+1990.546083619" watchObservedRunningTime="2026-07-09 04:33:13.170632183 +0000 UTC m=+1990.546463246" Jul 09 04:33:14.080654 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:14.080610 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:14.085630 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:14.085605 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:14.154394 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:14.154363 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:14.155451 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:14.155427 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:15.083384 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.083342 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:15.178009 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.177977 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:15.246852 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.246799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:15.444146 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.444038 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:15.615292 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.615258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:15.713937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:15.713842 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:17.400511 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.400486 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:17.548065 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548027 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548078 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548108 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548136 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548252 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548216 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548282 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg92g\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548310 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548365 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo\") pod \"0d9503e1-66bf-48c9-abb0-c31130180511\" (UID: \"0d9503e1-66bf-48c9-abb0-c31130180511\") " Jul 09 04:33:17.548498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548426 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:17.548706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548527 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:17.548706 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548670 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:17.548860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548758 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.548860 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548776 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.548981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.548882 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:33:17.549113 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.549056 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:17.550549 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.550531 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:33:17.550734 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.550710 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g" (OuterVolumeSpecName: "kube-api-access-jg92g") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "kube-api-access-jg92g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:17.550932 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.550915 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:33:17.550990 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.550974 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d9503e1-66bf-48c9-abb0-c31130180511" (UID: "0d9503e1-66bf-48c9-abb0-c31130180511"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:33:17.649515 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649479 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg92g\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-kube-api-access-jg92g\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649515 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649513 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d9503e1-66bf-48c9-abb0-c31130180511-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649515 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649526 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d9503e1-66bf-48c9-abb0-c31130180511-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649538 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649551 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649562 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d9503e1-66bf-48c9-abb0-c31130180511-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:17.649762 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:17.649572 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d9503e1-66bf-48c9-abb0-c31130180511-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:33:18.176010 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.175973 2563 generic.go:356] "Generic (PLEG): container finished" podID="0d9503e1-66bf-48c9-abb0-c31130180511" containerID="fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489" exitCode=0 Jul 09 04:33:18.176190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.176035 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" Jul 09 04:33:18.176190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.176043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerDied","Data":"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489"} Jul 09 04:33:18.176190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.176092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd" event={"ID":"0d9503e1-66bf-48c9-abb0-c31130180511","Type":"ContainerDied","Data":"a080a3a7bfc45977a0c8645f18170a59cc8d25d68c54e62f931fb7d23b368def"} Jul 09 04:33:18.176190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.176120 2563 scope.go:117] "RemoveContainer" containerID="fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489" Jul 09 04:33:18.185032 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.185013 2563 scope.go:117] "RemoveContainer" containerID="7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4" Jul 09 04:33:18.192885 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.192862 2563 scope.go:117] "RemoveContainer" containerID="fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489" Jul 09 04:33:18.193147 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:33:18.193126 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489\": container with ID starting with fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489 not found: ID does not exist" containerID="fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489" Jul 09 04:33:18.193197 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.193156 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489"} err="failed to get container status \"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489\": rpc error: code = NotFound desc = could not find container \"fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489\": container with ID starting with fd44a0bc253f26f566f3858ef60e0fb1efe3f88e047ac59528a5be82b31cf489 not found: ID does not exist" Jul 09 04:33:18.193197 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.193172 2563 scope.go:117] "RemoveContainer" containerID="7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4" Jul 09 04:33:18.193451 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:33:18.193435 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4\": container with ID starting with 7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4 not found: ID does not exist" containerID="7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4" Jul 09 04:33:18.193506 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.193454 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4"} err="failed to get container status \"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4\": rpc error: code = NotFound desc = could not find container \"7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4\": container with ID starting with 7273252dbe0a7ac14fc9adeb5b6eff478d7c80292bdb088d944dae41f4a07cb4 not found: ID does not exist" Jul 09 04:33:18.197717 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.197696 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:33:18.201049 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:18.201028 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a54d19-openshift-default-7c487cdd57-fflzd"] Jul 09 04:33:19.136949 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:19.136915 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" path="/var/lib/kubelet/pods/0d9503e1-66bf-48c9-abb0-c31130180511/volumes" Jul 09 04:33:19.631052 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:19.631015 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:19.974469 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:19.974373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:20.259251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259167 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259520 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259532 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee6b1468-b10e-4a95-a47e-9339c1b96709" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259560 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259566 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259574 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259579 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259647 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.259739 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.259656 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9503e1-66bf-48c9-abb0-c31130180511" containerName="istio-proxy" Jul 09 04:33:20.262886 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.262860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.265511 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.265488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-332f6a-openshift-default-dockercfg-qznb5\"" Jul 09 04:33:20.275268 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.275241 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:33:20.289957 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.289915 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:20.376323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376323 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376356 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376452 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376579 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z248d\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.376872 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.376668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477620 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477572 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477620 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z248d\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.477938 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.477972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478034 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478154 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478411 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478473 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478444 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.478616 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.478596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.480265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.480238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.480440 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.480417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.485908 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.485876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.486002 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.485935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z248d\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d\") pod \"e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.574704 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.574672 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:20.657559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.657521 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:20.734753 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.734728 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:33:20.736214 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:33:20.736184 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf51872_b473_4bf2_9662_c9344514520b.slice/crio-10821a18431ab43cead6fbc07f5097bfc4e4a08fe24e10ed143282de2072a49b WatchSource:0}: Error finding container 10821a18431ab43cead6fbc07f5097bfc4e4a08fe24e10ed143282de2072a49b: Status 404 returned error can't find the container with id 10821a18431ab43cead6fbc07f5097bfc4e4a08fe24e10ed143282de2072a49b Jul 09 04:33:20.738583 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.738529 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:20.738680 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.738631 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:20.738722 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:20.738675 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:21.195046 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:21.195008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerStarted","Data":"285656737fcdd8c89225f9a0b8fc45eaa99bd75bb60f7a067370e3182cd00811"} Jul 09 04:33:21.195248 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:21.195061 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerStarted","Data":"10821a18431ab43cead6fbc07f5097bfc4e4a08fe24e10ed143282de2072a49b"} Jul 09 04:33:21.215510 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:21.215455 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podStartSLOduration=1.215436205 podStartE2EDuration="1.215436205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:33:21.213292671 +0000 UTC m=+1998.589123733" watchObservedRunningTime="2026-07-09 04:33:21.215436205 +0000 UTC m=+1998.591267268" Jul 09 04:33:21.575116 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:21.575086 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:21.580238 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:21.580211 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:22.203814 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:22.203775 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:22.206418 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:22.206387 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:23.211779 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:23.211700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:23.297400 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:23.297366 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:23.371507 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:23.371461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:23.744326 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:23.744289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:23.841342 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:23.841307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:24.692805 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:24.692690 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:27.731841 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:27.731797 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:29.155731 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.155697 2563 patch_prober.go:28] interesting pod/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 09 04:33:29.156173 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.155765 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 09 04:33:29.241930 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.241895 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerID="fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7" exitCode=0 Jul 09 04:33:29.242143 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.241937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerDied","Data":"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7"} Jul 09 04:33:29.242311 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.242296 2563 scope.go:117] "RemoveContainer" containerID="fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7" Jul 09 04:33:29.243316 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.243288 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:29.243367 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.243355 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:29.243411 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:29.243400 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:30.248401 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:30.248367 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerStarted","Data":"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70"} Jul 09 04:33:31.080677 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:31.080638 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:31.080927 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:31.080903 2563 patch_prober.go:28] interesting pod/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 09 04:33:31.080986 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:31.080953 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 09 04:33:32.081311 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:32.081264 2563 patch_prober.go:28] interesting pod/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 09 04:33:32.081770 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:32.081356 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 09 04:33:33.081670 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:33.081631 2563 patch_prober.go:28] interesting pod/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 09 04:33:33.082165 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:33.081688 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 09 04:33:34.081683 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:34.081644 2563 patch_prober.go:28] interesting pod/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 09 04:33:34.082123 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:34.081700 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 09 04:33:35.085150 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.085119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:35.085559 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.085409 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:35.086214 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.086196 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:33:35.274312 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.274280 2563 generic.go:356] "Generic (PLEG): container finished" podID="7cf51872-b473-4bf2-9662-c9344514520b" containerID="285656737fcdd8c89225f9a0b8fc45eaa99bd75bb60f7a067370e3182cd00811" exitCode=0 Jul 09 04:33:35.274496 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.274361 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerDied","Data":"285656737fcdd8c89225f9a0b8fc45eaa99bd75bb60f7a067370e3182cd00811"} Jul 09 04:33:35.274870 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.274855 2563 scope.go:117] "RemoveContainer" containerID="285656737fcdd8c89225f9a0b8fc45eaa99bd75bb60f7a067370e3182cd00811" Jul 09 04:33:35.275797 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.275773 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:35.275877 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.275858 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:35.275917 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:35.275899 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 09 04:33:36.256069 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.256030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:36.280681 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.280643 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerStarted","Data":"f3dcc480e88a4cdd4267e8af671dd2f749a32ea72eb6cca05b6d2e078844f801"} Jul 09 04:33:36.316916 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.316879 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:36.575502 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.575453 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:36.576673 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.576644 2563 patch_prober.go:28] interesting pod/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 09 04:33:36.576793 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:36.576697 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 09 04:33:37.203942 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:37.203898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:37.575514 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:37.575478 2563 patch_prober.go:28] interesting pod/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 09 04:33:37.575941 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:37.575541 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 09 04:33:38.576035 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:38.575995 2563 patch_prober.go:28] interesting pod/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 09 04:33:38.576441 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:38.576059 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 09 04:33:39.575892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:39.575819 2563 patch_prober.go:28] interesting pod/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 09 04:33:39.576084 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:39.575925 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 09 04:33:40.579550 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:40.579514 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:40.580680 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:40.580661 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:33:44.506388 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:44.506321 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:33:45.189071 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:33:45.189026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:34:43.324493 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:34:43.324413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:35:03.210088 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:35:03.210051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:35:03.214980 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:35:03.214959 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:36:32.725265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:32.725228 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:32.819700 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:32.819658 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:33.298919 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:33.298857 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:33.398900 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:33.398861 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:33.537106 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:33.537061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:39.036656 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.036617 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:39.098275 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.098238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:39.293155 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.293059 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:36:39.293349 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.293310 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" containerID="cri-o://0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70" gracePeriod=30 Jul 09 04:36:39.371838 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.371785 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:39.695858 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:39.695742 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:40.130406 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:40.130368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:40.231450 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:40.231413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:40.344048 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:40.344010 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:44.547731 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.547707 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:36:44.675152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675057 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675106 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjpw4\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675152 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675124 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675163 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675240 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675270 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675311 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675355 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:44.675436 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675378 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data\") pod \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\" (UID: \"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2\") " Jul 09 04:36:44.675806 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675680 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:36:44.675954 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.675910 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:44.676110 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.676004 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:44.676196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.676089 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.676196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.676139 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.676547 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.676521 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:44.677604 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.677577 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:36:44.677712 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.677642 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:36:44.677712 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.677645 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4" (OuterVolumeSpecName: "kube-api-access-gjpw4") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "kube-api-access-gjpw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:36:44.677904 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.677881 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" (UID: "b0ebcd80-b2c7-45fa-96bd-7363c5151ba2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:44.777225 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777187 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjpw4\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-kube-api-access-gjpw4\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777225 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777224 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777239 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777252 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777264 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777276 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:44.777463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:44.777286 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:45.157889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.157857 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerID="0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70" exitCode=0 Jul 09 04:36:45.158086 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.157918 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" Jul 09 04:36:45.158086 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.157946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerDied","Data":"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70"} Jul 09 04:36:45.158086 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.158003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn" event={"ID":"b0ebcd80-b2c7-45fa-96bd-7363c5151ba2","Type":"ContainerDied","Data":"e9f1a972bee1cb44dfb6324e9708403038d597e5de262666aa99e66483dca061"} Jul 09 04:36:45.158086 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.158024 2563 scope.go:117] "RemoveContainer" containerID="0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70" Jul 09 04:36:45.166787 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.166769 2563 scope.go:117] "RemoveContainer" containerID="fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7" Jul 09 04:36:45.177876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.177777 2563 scope.go:117] "RemoveContainer" containerID="0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70" Jul 09 04:36:45.178284 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:36:45.178260 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70\": container with ID starting with 0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70 not found: ID does not exist" containerID="0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70" Jul 09 04:36:45.178371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.178299 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70"} err="failed to get container status \"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70\": rpc error: code = NotFound desc = could not find container \"0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70\": container with ID starting with 0866236ebbb9e82bce8a7889ea38541cb4b5e0f7c412802e6207444aff7efe70 not found: ID does not exist" Jul 09 04:36:45.178371 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.178320 2563 scope.go:117] "RemoveContainer" containerID="fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7" Jul 09 04:36:45.178644 ip-10-0-132-152 kubenswrapper[2563]: E0709 04:36:45.178622 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7\": container with ID starting with fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7 not found: ID does not exist" containerID="fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7" Jul 09 04:36:45.178688 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.178652 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7"} err="failed to get container status \"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7\": rpc error: code = NotFound desc = could not find container \"fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7\": container with ID starting with fbf13196b1fc531053f08cdc4af80992e11a47f19d7015eb22fd4dc6338a0eb7 not found: ID does not exist" Jul 09 04:36:45.179925 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.179883 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:36:45.181974 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.181952 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-48a065-openshift-default-dd47d4575-8nczn"] Jul 09 04:36:45.691265 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.691226 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:45.753059 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.753019 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:45.991562 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.991471 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:36:45.991743 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:45.991684 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" containerID="cri-o://f3dcc480e88a4cdd4267e8af671dd2f749a32ea72eb6cca05b6d2e078844f801" gracePeriod=30 Jul 09 04:36:46.048288 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:46.048240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:36:47.134111 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:47.134077 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" path="/var/lib/kubelet/pods/b0ebcd80-b2c7-45fa-96bd-7363c5151ba2/volumes" Jul 09 04:36:51.187708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.187676 2563 generic.go:356] "Generic (PLEG): container finished" podID="7cf51872-b473-4bf2-9662-c9344514520b" containerID="f3dcc480e88a4cdd4267e8af671dd2f749a32ea72eb6cca05b6d2e078844f801" exitCode=0 Jul 09 04:36:51.188190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.187750 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerDied","Data":"f3dcc480e88a4cdd4267e8af671dd2f749a32ea72eb6cca05b6d2e078844f801"} Jul 09 04:36:51.188190 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.187845 2563 scope.go:117] "RemoveContainer" containerID="285656737fcdd8c89225f9a0b8fc45eaa99bd75bb60f7a067370e3182cd00811" Jul 09 04:36:51.234075 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.234052 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:36:51.337367 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337335 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337611 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337394 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337611 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337438 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337611 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337545 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337611 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337599 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337675 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337704 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337734 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z248d\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337754 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337776 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert\") pod \"7cf51872-b473-4bf2-9662-c9344514520b\" (UID: \"7cf51872-b473-4bf2-9662-c9344514520b\") " Jul 09 04:36:51.337876 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.337792 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:51.338172 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.338125 2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.338172 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.338145 2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-workload-certs\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.338271 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.338239 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 04:36:51.338321 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.338300 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:51.338803 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.338777 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:51.340087 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.340066 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 04:36:51.340087 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.340078 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d" (OuterVolumeSpecName: "kube-api-access-z248d") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "kube-api-access-z248d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:36:51.340254 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.340239 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 04:36:51.340295 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.340254 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cf51872-b473-4bf2-9662-c9344514520b" (UID: "7cf51872-b473-4bf2-9662-c9344514520b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 04:36:51.439498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439453 2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-credential-socket\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439489 2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-data\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439498 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439505 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z248d\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-kube-api-access-z248d\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439516 2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf51872-b473-4bf2-9662-c9344514520b-istiod-ca-cert\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439528 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf51872-b473-4bf2-9662-c9344514520b-istio-token\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439538 2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf51872-b473-4bf2-9662-c9344514520b-istio-podinfo\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.439758 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.439548 2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf51872-b473-4bf2-9662-c9344514520b-istio-envoy\") on node \"ip-10-0-132-152.ec2.internal\" DevicePath \"\"" Jul 09 04:36:51.910879 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:51.910817 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pszg9_f679d2f2-a2d5-4f7f-aaea-a6e1300be970/server/0.log" Jul 09 04:36:52.193581 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.193497 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" Jul 09 04:36:52.194017 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.193496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh" event={"ID":"7cf51872-b473-4bf2-9662-c9344514520b","Type":"ContainerDied","Data":"10821a18431ab43cead6fbc07f5097bfc4e4a08fe24e10ed143282de2072a49b"} Jul 09 04:36:52.194017 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.193634 2563 scope.go:117] "RemoveContainer" containerID="f3dcc480e88a4cdd4267e8af671dd2f749a32ea72eb6cca05b6d2e078844f801" Jul 09 04:36:52.214846 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.214783 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:36:52.218541 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.218518 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-332f6a-openshift-default-69f7474bc9-rfxmh"] Jul 09 04:36:52.416095 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.416063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67dd5f9985-s4ppl_160af334-bb00-4171-93b3-d3a256a80d80/copy-manifests/0.log" Jul 09 04:36:52.433933 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:52.433898 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67dd5f9985-s4ppl_160af334-bb00-4171-93b3-d3a256a80d80/manager/0.log" Jul 09 04:36:53.135815 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:53.135779 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cf51872-b473-4bf2-9662-c9344514520b" path="/var/lib/kubelet/pods/7cf51872-b473-4bf2-9662-c9344514520b/volumes" Jul 09 04:36:55.045942 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:55.045906 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dlnn2t_eedf00d3-b045-41f9-9464-e3836b1b69a2/istio-proxy/0.log" Jul 09 04:36:55.174516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:55.174478 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jkd6q_0a810e86-ba77-43ec-8323-8badbc52d08b/discovery/0.log" Jul 09 04:36:55.792981 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:55.792936 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zv6tt_bf5fd576-73fa-4919-9ad7-eabe654ebe1d/payload-processing/0.log" Jul 09 04:36:56.392957 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:56.392928 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cvpfr_da764d5f-da67-4352-8d5a-0217531e0723/main/0.log" Jul 09 04:36:56.751393 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:36:56.751303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-j55n9_d75983f0-259b-4244-9cd0-c2b2a9f2d603/main/0.log" Jul 09 04:37:01.129794 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:01.129751 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:37:01.227289 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:01.227242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:37:04.090894 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:04.090862 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9c5rl_64a11f65-1fb8-4a92-8f1c-a37df9602807/global-pull-secret-syncer/0.log" Jul 09 04:37:04.180931 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:04.180879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" Jul 09 04:37:04.259647 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:04.259601 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-152.ec2.internal_51acc6f74353a35d5f168e3015e79515/haproxy/0.log" Jul 09 04:37:10.936250 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:10.936202 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/alertmanager/0.log" Jul 09 04:37:10.955601 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:10.955568 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/config-reloader/0.log" Jul 09 04:37:10.979643 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:10.979608 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/kube-rbac-proxy-web/0.log" Jul 09 04:37:10.995448 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:10.995420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/kube-rbac-proxy/0.log" Jul 09 04:37:11.012615 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.012576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/kube-rbac-proxy-metric/0.log" Jul 09 04:37:11.030416 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.030393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/prom-label-proxy/0.log" Jul 09 04:37:11.047216 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.047188 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7563e6b4-2582-4f52-bb95-b2c81aa84e30/init-config-reloader/0.log" Jul 09 04:37:11.221333 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.221245 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-9nhtx_a3e3ef09-8b53-4387-a05b-47e9e8314691/monitoring-plugin/0.log" Jul 09 04:37:11.250125 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.250092 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr28n_e42bb36e-a51a-4e57-bb7f-8028b2453ce0/node-exporter/0.log" Jul 09 04:37:11.282463 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.282411 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr28n_e42bb36e-a51a-4e57-bb7f-8028b2453ce0/kube-rbac-proxy/0.log" Jul 09 04:37:11.300796 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.300767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr28n_e42bb36e-a51a-4e57-bb7f-8028b2453ce0/init-textfile/0.log" Jul 09 04:37:11.461337 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.461307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m75ks_c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4/kube-rbac-proxy-main/0.log" Jul 09 04:37:11.484986 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.484902 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m75ks_c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4/kube-rbac-proxy-self/0.log" Jul 09 04:37:11.498533 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.498504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m75ks_c5bc9ba5-586c-4080-9a0f-cdf2d6c119c4/openshift-state-metrics/0.log" Jul 09 04:37:11.802509 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.802484 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4cb75b66-k5pxx_a10cd3b6-da36-4113-99e2-30b796548bce/telemeter-client/0.log" Jul 09 04:37:11.819103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.819081 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4cb75b66-k5pxx_a10cd3b6-da36-4113-99e2-30b796548bce/reload/0.log" Jul 09 04:37:11.844439 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:11.844411 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c4cb75b66-k5pxx_a10cd3b6-da36-4113-99e2-30b796548bce/kube-rbac-proxy/0.log" Jul 09 04:37:14.691477 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691433 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq"] Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691816 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691848 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691869 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691878 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691894 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" Jul 09 04:37:14.691915 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691903 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" Jul 09 04:37:14.692186 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691974 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cf51872-b473-4bf2-9662-c9344514520b" containerName="istio-proxy" Jul 09 04:37:14.692186 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.691985 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ebcd80-b2c7-45fa-96bd-7363c5151ba2" containerName="istio-proxy" Jul 09 04:37:14.694196 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.694174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.696892 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.696865 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-85fmr\"/\"default-dockercfg-hslpv\"" Jul 09 04:37:14.697005 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.696871 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-85fmr\"/\"kube-root-ca.crt\"" Jul 09 04:37:14.697950 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.697931 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-85fmr\"/\"openshift-service-ca.crt\"" Jul 09 04:37:14.704546 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.704522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq"] Jul 09 04:37:14.726907 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.726875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-sys\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.727103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.726935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-lib-modules\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.727103 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.727017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-podres\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.727227 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.727134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-proc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.727227 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.727167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj6mc\" (UniqueName: \"kubernetes.io/projected/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-kube-api-access-gj6mc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828467 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828428 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-lib-modules\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828467 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-podres\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-proc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828560 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj6mc\" (UniqueName: \"kubernetes.io/projected/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-kube-api-access-gj6mc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-sys\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828653 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-proc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828664 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-sys\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828708 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828623 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-lib-modules\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.828939 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.828763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-podres\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:14.836495 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:14.836469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj6mc\" (UniqueName: \"kubernetes.io/projected/e0f4d4b7-b99c-4c60-9d21-a3f8fb506577-kube-api-access-gj6mc\") pod \"perf-node-gather-daemonset-x2wsq\" (UID: \"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577\") " pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:15.004867 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.004759 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:15.138251 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.138218 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq"] Jul 09 04:37:15.141182 ip-10-0-132-152 kubenswrapper[2563]: W0709 04:37:15.141152 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode0f4d4b7_b99c_4c60_9d21_a3f8fb506577.slice/crio-6d73be54bdd824162f1b59f73c50489c108075a3fdd723b454a56affdcb3a00e WatchSource:0}: Error finding container 6d73be54bdd824162f1b59f73c50489c108075a3fdd723b454a56affdcb3a00e: Status 404 returned error can't find the container with id 6d73be54bdd824162f1b59f73c50489c108075a3fdd723b454a56affdcb3a00e Jul 09 04:37:15.299479 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.299442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" event={"ID":"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577","Type":"ContainerStarted","Data":"af44af6074c6d31a7e7ff5ac47672df8c7ad0b5727116d5c81ea961a835fd725"} Jul 09 04:37:15.299652 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.299502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" event={"ID":"e0f4d4b7-b99c-4c60-9d21-a3f8fb506577","Type":"ContainerStarted","Data":"6d73be54bdd824162f1b59f73c50489c108075a3fdd723b454a56affdcb3a00e"} Jul 09 04:37:15.299652 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.299545 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:15.315895 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:15.315842 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" podStartSLOduration=1.315811224 podStartE2EDuration="1.315811224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:15.314242218 +0000 UTC m=+2232.690073272" watchObservedRunningTime="2026-07-09 04:37:15.315811224 +0000 UTC m=+2232.691642287" Jul 09 04:37:16.064632 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:16.064591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gxkz_1d0a65f8-dc27-44f3-813e-35f8feb07e0a/dns/0.log" Jul 09 04:37:16.080291 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:16.080255 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gxkz_1d0a65f8-dc27-44f3-813e-35f8feb07e0a/kube-rbac-proxy/0.log" Jul 09 04:37:16.210790 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:16.210756 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw67f_1b8ede72-26f2-4e07-a7cc-646b9d0e3abf/dns-node-resolver/0.log" Jul 09 04:37:16.783882 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:16.783849 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cblsd_16746381-a780-4428-be80-fa590d45f7ee/node-ca/0.log" Jul 09 04:37:17.074504 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:17.074409 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2xs9c_bb65c651-889f-43d7-bb05-1f9e0b7e41a6/konnectivity-agent/0.log" limit=1024 Jul 09 04:37:17.688884 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:17.688856 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dlnn2t_eedf00d3-b045-41f9-9464-e3836b1b69a2/istio-proxy/0.log" Jul 09 04:37:17.858392 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:17.858361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jkd6q_0a810e86-ba77-43ec-8323-8badbc52d08b/discovery/0.log" Jul 09 04:37:18.104446 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:18.104404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zv6tt_bf5fd576-73fa-4919-9ad7-eabe654ebe1d/payload-processing/0.log" Jul 09 04:37:18.789072 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:18.789044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-brv8l_c8180b1f-8fde-420b-97ef-a6b945ad821b/serve-healthcheck-canary/0.log" Jul 09 04:37:19.265118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:19.265039 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llq2j_68222cc3-7c8a-43e9-a957-6191c3f36d25/kube-rbac-proxy/0.log" Jul 09 04:37:19.283740 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:19.283689 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llq2j_68222cc3-7c8a-43e9-a957-6191c3f36d25/exporter/0.log" Jul 09 04:37:19.301246 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:19.301206 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-llq2j_68222cc3-7c8a-43e9-a957-6191c3f36d25/extractor/0.log" Jul 09 04:37:21.314110 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:21.314081 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-85fmr/perf-node-gather-daemonset-x2wsq" Jul 09 04:37:21.903941 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:21.903908 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pszg9_f679d2f2-a2d5-4f7f-aaea-a6e1300be970/server/0.log" Jul 09 04:37:22.177753 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:22.177675 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67dd5f9985-s4ppl_160af334-bb00-4171-93b3-d3a256a80d80/manager/0.log" Jul 09 04:37:22.191465 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:22.191443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67dd5f9985-s4ppl_160af334-bb00-4171-93b3-d3a256a80d80/copy-manifests/0.log" Jul 09 04:37:23.387124 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:23.387086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-ff67c745d-vpk4d_e4211823-c5e9-4598-abfb-6c9d6695de78/manager/0.log" Jul 09 04:37:23.410486 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:23.410459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vtdd5_d8356baa-e237-4896-aee5-2766534271ec/openshift-lws-operator/0.log" Jul 09 04:37:24.504779 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:24.504684 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dlnn2t_eedf00d3-b045-41f9-9464-e3836b1b69a2/istio-proxy/0.log" Jul 09 04:37:24.678382 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:24.678336 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jkd6q_0a810e86-ba77-43ec-8323-8badbc52d08b/discovery/0.log" Jul 09 04:37:24.892840 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:24.892794 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zv6tt_bf5fd576-73fa-4919-9ad7-eabe654ebe1d/payload-processing/0.log" Jul 09 04:37:26.034491 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:26.034456 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dlnn2t_eedf00d3-b045-41f9-9464-e3836b1b69a2/istio-proxy/0.log" Jul 09 04:37:26.202813 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:26.202777 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jkd6q_0a810e86-ba77-43ec-8323-8badbc52d08b/discovery/0.log" Jul 09 04:37:26.419767 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:26.419686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zv6tt_bf5fd576-73fa-4919-9ad7-eabe654ebe1d/payload-processing/0.log" Jul 09 04:37:28.447590 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:28.447551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4ppb4_297ab8c1-40c7-43bb-a434-6168aa52947c/migrator/0.log" Jul 09 04:37:28.462592 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:28.462563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4ppb4_297ab8c1-40c7-43bb-a434-6168aa52947c/graceful-termination/0.log" Jul 09 04:37:30.121821 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.121791 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/kube-multus-additional-cni-plugins/0.log" Jul 09 04:37:30.140732 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.140702 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/egress-router-binary-copy/0.log" Jul 09 04:37:30.163446 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.163420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/cni-plugins/0.log" Jul 09 04:37:30.179553 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.179524 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/bond-cni-plugin/0.log" Jul 09 04:37:30.202937 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.202911 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/routeoverride-cni/0.log" Jul 09 04:37:30.223169 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.223140 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/whereabouts-cni-bincopy/0.log" Jul 09 04:37:30.241516 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.241480 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hxd6f_618acde9-2f54-45b6-9c8a-b93383698ef2/whereabouts-cni/0.log" Jul 09 04:37:30.342794 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.342767 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vkj7n_8f165785-2bea-4425-a941-20a9fe239172/kube-multus/0.log" Jul 09 04:37:30.394686 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.394599 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rmwnt_7ec00541-a6a5-47e5-a1cc-14185bedfc23/network-metrics-daemon/0.log" Jul 09 04:37:30.409118 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:30.409081 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rmwnt_7ec00541-a6a5-47e5-a1cc-14185bedfc23/kube-rbac-proxy/0.log" Jul 09 04:37:31.361064 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.361030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-controller/0.log" Jul 09 04:37:31.373428 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.373397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/0.log" Jul 09 04:37:31.373596 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.373405 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovn-acl-logging/1.log" Jul 09 04:37:31.387149 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.387118 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/kube-rbac-proxy-node/0.log" Jul 09 04:37:31.404504 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.404461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 04:37:31.419399 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.419358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/northd/0.log" Jul 09 04:37:31.434812 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.434772 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/nbdb/0.log" Jul 09 04:37:31.449776 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.449742 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/sbdb/0.log" Jul 09 04:37:31.518889 ip-10-0-132-152 kubenswrapper[2563]: I0709 04:37:31.518857 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dbv6k_519c1872-7de3-4c69-abbb-83251c7fadb2/ovnkube-controller/0.log"